您现在的位置是:Meta's Data2vec 2.0: Second time around is faster >>正文
Meta's Data2vec 2.0: Second time around is faster
后花园论坛社区|2024夜上海论坛网|爱上海419论坛 -- Back garden5138人已围观
简介Meta's Data2vec is an example of a generalist neural network that can use the same exact code to cru...
Meta's Data2vec is an example of a generalist neural network that can use the same exact code to crunch examples of data in different modalities -- in this case, speech, text, and images -- and make predictions about that data.
Baevski et al.What do you do when you've proven your point in neural networks?
Do it faster is one answer.
On Tuesday, Meta, the owner of Facebook, Instagram, and WhatsApp, unveiled Data2vec 2.0, a revamp of a neural network introduced earlier this year that behaves as a sort of generalist, performing on tasks that involve text, image, and speech data with the same basic approach to all three.
Featured
- Garmin wins big at CES, launches new products and updates Garmin Connect
- From indoor solar to light-based internet, photonics offers a brighter future
- I saw Samsung and LG's new transparent TVs at CES, and there's a clear winner
- Have 10 hours? IBM will train you in AI fundamentals - for free
The authors this time made two key changes to Data2vec to make it faster: using "convolutions," and "amortizing" the compressed representations of the teacher network.
On the first score, the student network that has to predict the representations of the teacher is no longer using the part of the Transformer called a decoder to do so.
AI in 2023: A year of breakthroughs that left no human thing unchanged These are the jobs most likely to be taken over by AI AI at the edge: 5G and the Internet of Things see fast times ahead Almost half of tech executives say their organizations aren't ready for AI or other advanced initiatives AI in 2023: A year of breakthroughs that left no human thing unchangedTags:
转载:欢迎各位朋友分享到网络,但转载请说明文章出处“后花园论坛社区|2024夜上海论坛网|爱上海419论坛 -- Back garden”。http://dzbz.com.cn/news/9985.html
相关文章
These 5 major tech advances of 2023 were the biggest game
Meta's Data2vec 2.0: Second time around is fasterA crowd examining the Microsoft Surface Studio 2+ at the company's New York City event in September....
阅读更多
OpenAI found a way to make AI models more logical and avoid hallucinations
Meta's Data2vec 2.0: Second time around is fasterUserba011d64_201/Getty ImagesAlthough AI models are advanced and can do extraordinary things, they a...
阅读更多
AMD unveils MI300x AI chip as 'generative AI accelerator'
Meta's Data2vec 2.0: Second time around is fasterAMD's Instinct MI300X GPU features multiple GPU "chiplets" plus 192 gigabytes of HBM3 DRAM memory, a...
阅读更多
热门文章
- The future of work includes high
- Chegg is getting a generative AI makeover just in time for back
- Despite the gloomy headlines, demand for tech skills is strong
- 6 AI tools to supercharge your work and everyday life
- OpenShift 4.10: Red Hat teams with Nvidia to add AI and machine learning
- Microsoft filed a patent for an AI backpack straight out of a sci
最新文章
Harvard is using ChatGPT to teach computer science
Harvard is using ChatGPT to teach computer science
Amazon now using generative AI to summarize customer reviews
Google Labs rolls out its 'AI
How to use Claude AI (and how it's different from ChatGPT)
Calm's new sleep story is 'narrated' by Jimmy Stewart, and it's spookily effective