weekend ai reads for 2024-05-31

📰 ABOVE THE FOLD: BILLIONAIRES PONTIFICATING

Nvidia will now make new AI chips every year / The Verge (3 minute read)

Jensen Huang:

The next company who reaches the next major plateau gets to announce a groundbreaking AI, and the second one after that gets to announce something that’s 0.3 percent better. Do you want to be the company delivering groundbreaking AI, or the company, you know, delivering 0.3 percent better?

Advanced computing is now core to the security and prosperity of our nation; we need it to optimize national intelligence, pursue scientific breakthroughs like fusion reactions, accelerate advanced materials discovery, ensure the cybersecurity of our financial markets and critical infrastructure, and more.

not quite billionaires but probably, eventually:

We are testing all of this, and this is a case where we didn’t trigger the AI Overview because we felt like our AI Overview is not necessarily the first experience we want to provide for that query because what’s underlying is maybe a better first look for the user — those are all quality tradeoffs we are making.

“The thing that is striking to me is the rate of diffusion,” Nadella tells me when I sit down with him in Jakarta. “If I had come to Indonesia in the second year of cloud, or even the server, obviously, there would have been some adoption, but it wouldn’t have been this broad and this fast.” 

 

📻 QUOTE OF THE WEEK

A potential negative aspect of understanding that the purpose of a system is what it does, is that we are then burdened with the horrible but hopefully galvanizing knowledge of this reality. For example, when our carceral system causes innocent people to be held in torturous or even deadly conditions because they could not afford bail, we must understand that this is the system working correctly. It is doing the thing it is designed to do.

Anil Dash (source)

 

🏗️ FOUNDATIONS & CULTURE

AI companies freeze out partisan media / Semafor (5 minute read)

And fringier, more explicitly ideological outlets on the right have noticed that their businesses — already rocked by an industry-wide decline in web traffic — seem unlikely to get an AI bailout.

AI Companions Combat Loneliness / Neuroscience News (5 minute read)

How it feels to get an AI email from a friend / Neven Mrgan (5 minute read)

It felt like getting a birthday card with only the prewritten message inside, and no added well-wishes from the wisher’s own pen. An item off the shelf, paid for and handed over, transaction complete.

 

🎓 EDUCATION

The market for AI in personalized learning is forecast to grow at a CAGR of 44.3% to reach $48.7 billion by 2030 – up from $5.2 billion in 2022.

AI helps 73% of students understand the learning material better and 63% study more efficiently.

“This year, everyone coming in here will have prompt engineering training to get them ready for the AI of the future,” Mary Erdoes, who runs the asset- and wealth-management unit, said at the firm’s investor day Monday.

The future of learning: AI is revolutionizing education 4.0 / World Economic Forum (7 minute read)

Four Singularities for Research / One Useful Thing (Ethan Mollick), Substack (sorry) (11 minute read)

A narrow singularity is a future point in human affairs where AI has so altered a field or industry that we cannot fully imagine what the world on the other side of that singularity looks like. I think academic research is facing at least four of these narrow singularities.

via stephanie, Governor Hochul Proposes $400 Million For University AI Consortium / Forbes (4 minute read)

 

📊 DATA & TECHNOLOGY

The future of foundation models is closed-source / luttig's learnings, Substack (sorry) (14 minute read)

Unlike other model providers, Meta is not in the business of selling model access via API. So while they'll open-source as long as it is convenient for them, developers are on their own for model improvements thereafter.

That begs the question: if Meta is only pursuing open-source insofar as it benefits themselves, what is the tipping point at which Meta stops open-sourcing their AI? Sooner than you think:

Using a three-stage framework for Gen AI development (near, mid and long-term), we analyze the risks and opportunities of open-source generative AI models with similar capabilities to the ones currently available (near to mid-term) and with greater capabilities (long-term). We argue that, overall, the benefits of open-source Gen AI outweigh its risks. As such, we encourage the open sourcing of models, training and evaluation data, and provide a set of recommendations and best practices for managing risks associated with open-source generative AI.

The most important question when designing AI / The Brookings Institution (10 minute read)

Team-level CI depends on collaboration, understood by behavioral scientists as aligning “mental models” to achieve shared goals. Research shows collaboration is often confounded by our tendency to anchor on information that we already know and our limited ability to fully integrate others’ perspectives into our own mental models, especially when communication load is high.

While LM evaluation is difficult and suffers from a number of challenges as we have described, there are measures that can be taken to significantly improve current practices. We provide our high-level recommendations regarding such measures, and detail our motivations briefly for each.

  • for example:

If possible, full evaluation code including the full prompts used should also be provided for reproducible evaluation runs, as well as further identifiers such as links to specific commits used. Failing this, sharing prompts is often not done, but can drastically improve reproducibility.

The dangerous side of pairwise evals is that you aren’t exactly sure what you’re measuring—for example, it’s not totally clear how much things like feel and style are weighted compared to correctness.

 

🎉 FUN and/or PRACTICAL THINGS

Delve — a ChatGPT interface for going down rabbit holes

Animated Drawings — Bring children's drawings to life, by animating characters to move around!

  • from Meta

  • easy to start; challenging to do well

3 Questions: What you need to know about audio deepfakes / MIT News (7 minute read; includes 13 minute video)

zero1cine — AI movie database

  • directory of short AI-generated “movies”

 

🧿 AI-ADJACENT

  • more book than paper, despite the hostname

  • 143-page PDF available here

The educational benefits of public libraries — Do investments in public libraries boost student test scores? / American Economic Association (3 minute read)

The figure shows that after a boost in library capital investment, reading test scores steadily increased. In the short run, library investments increased reading scores by 0.01 standard deviations. Seven years out from a project, scores were 0.04 standard deviations higher in districts that invested in public libraries than their counterparts.

  • continue to support your local libraries