Beste Academic Agent Podcasts (2024)

1
142 Gene Ang PhD~Arcturian Healing Method: Double Agent (Academic vs Esoteric), Warrior Initiation, ETs, Galactics, Tom Kenyon/Edgar Cayce, Mt Shasta & Tibet 1:00:17

7d ago1:00:17

1:00:17

Currently in CA, Gene Ang, PhD talks about his academic life via Stanford and Harvard to his spiritual expansion starting with the Course in Miracles as a sophomore. We then discuss the other esoteric studies that evolved him into what we termed on the show as "avant-garde" expanding the deep connection to galactic beings, moving through dimensions…

1
Do Academics Need Agents?: Part 1 of Publishing in Academia

15d ago

—

This bonus content is a reading from Platypus, the CASTAC Blog. The full post by Savannah Mandel can be read at https://blog.castac.org/2024/10/do-academics-need-agents-part-1-of-publishing-in-academia/. About the post: If you hope to someday publish with a trade press such as Penguin, Harper Collins, or Simon & Schuster, or are interested in havin…

1
"Woke Right": James Lindsay is Mental 23:24

27d ago23:24

23:24

Buy courses here: https://www.academic-agency.com/ Sub to my substack here: https://substack.com/profile/69785136-academic-agent Join the channel here: https://www.youtube.com/channel/UCyawG3aTE7RmNQcFQskDWcw/join Merch: https://aas-house-of-merchandise.creator-spring.com/ All my vital links: https://unpopular.academy/ ... https://www.youtube.com/w…

1
JC Returns to Element451 + Higher Ed's AI Reality Check as 91% of CTOs Feel Unprepared 46:00

1d ago46:00

46:00

In this milestone episode, Dr. JC Bonilla returns home to Element451 as COO and Head of AI Practice, joining forces again with CEO Ardis Kadiu after their 17-year journey from NYU to now. The timing is critical - new data shows 91% of higher education CTOs feel unprepared for AI adoption. The longtime friends discuss how Element451's AI-first appro…

1
[QA] LoRA vs Full Fine-tuning: An Illusion of Equivalence 7:47

1d ago7:47

7:47

This study analyzes the differences between full fine-tuning and LoRA in large language models, revealing distinct weight matrix structures and generalization behaviors despite similar performance on tasks. https://arxiv.org/abs//2410.21228 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: ht…

1
LoRA vs Full Fine-tuning: An Illusion of Equivalence 13:44

1d ago13:44

13:44

This study analyzes the differences between full fine-tuning and LoRA in large language models, revealing distinct weight matrix structures and generalization behaviors despite similar performance on tasks. https://arxiv.org/abs//2410.21228 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: ht…

1
[QA] Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad? 6:57

2d ago6:57

6:57

Vision-Language Models show promise in reasoning across text and images but struggle with basic visual concepts, revealing significant gaps in their understanding and generalization abilities. https://arxiv.org/abs//2410.19546 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts…

1
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad? 8:44

2d ago8:44

8:44

Vision-Language Models show promise in reasoning across text and images but struggle with basic visual concepts, revealing significant gaps in their understanding and generalization abilities. https://arxiv.org/abs//2410.19546 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts…

1
[QA] Computational Bottlenecks of Training Small-scale Large Language Models 8:10

2d ago8:10

8:10

This study investigates the training behavior and computational requirements of Small-scale Large Language Models (SLMs), focusing on hyperparameters and configurations to enhance efficiency and support low-resource AI research. https://arxiv.org/abs//2410.19456 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_pap…

1
Computational Bottlenecks of Training Small-scale Large Language Models 9:57

2d ago9:57

9:57

This study investigates the training behavior and computational requirements of Small-scale Large Language Models (SLMs), focusing on hyperparameters and configurations to enhance efficiency and support low-resource AI research. https://arxiv.org/abs//2410.19456 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_pap…

1
Special Episode: Grassroots Warrior Women~Eden, Lisa, Carole & Michelle: Matriots/Grid Work/Fem Ener/Election/Inspire 1:11:25

3d ago1:11:25

1:11:25

Powerhouse Michelle Schiau hosts me and two other spiritual facilitators and fellow co-anchors of the Grassroots Warrior Network on Rumble: Lisa Schermerhorn and Carole Maureen Friesen. In this beautiful round table discussion, we talk about what is going on in our world spiritually as our evolution is blasting off more than ever. This will possibl…

1
[QA] Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees 9:12

4d ago9:12

9:12

This paper introduces a hybrid approach combining physics-informed neural networks and cylindrical approximation to efficiently solve functional differential equations, addressing computational challenges and improving numerical analysis. https://arxiv.org/abs//2410.18153 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/…

1
Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees 19:53

4d ago19:53

19:53

This paper introduces a hybrid approach combining physics-informed neural networks and cylindrical approximation to efficiently solve functional differential equations, addressing computational challenges and improving numerical analysis. https://arxiv.org/abs//2410.18153 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/…

1
[QA] A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration 8:04

4d ago8:04

8:04

This paper shows that integrating coherent reasoning in Few-shot Chain-of-Thought prompting enhances transformer performance, revealing sensitivity to errors in intermediate steps and proposing improvements using varied reasoning paths. https://arxiv.org/abs//2410.16540 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@a…

1
A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration 18:20

4d ago18:20

18:20

This paper shows that integrating coherent reasoning in Few-shot Chain-of-Thought prompting enhances transformer performance, revealing sensitivity to errors in intermediate steps and proposing improvements using varied reasoning paths. https://arxiv.org/abs//2410.16540 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@a…

1
[QA] LEGO: Language Model Building Blocks 7:19

5d ago7:19

7:19

LEGO is a novel technique for extracting and recombining small language models from large language models, enhancing efficiency, robustness, and user data privacy while reducing costs. https://arxiv.org/abs//2410.18287 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.c…

1
LEGO: Language Model Building Blocks 16:46

5d ago16:46

16:46

LEGO is a novel technique for extracting and recombining small language models from large language models, enhancing efficiency, robustness, and user data privacy while reducing costs. https://arxiv.org/abs//2410.18287 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.c…

1
[QA] Knowledge Distillation Using Frontier Open-Source LLMs: Generalizability and the Role of Synthetic Data 8:13

5d ago8:13

8:13

This study explores knowledge distillation from Llama-3.1-405B to smaller models, demonstrating improved accuracy and efficiency through synthetic data and diverse evaluation methods across various tasks. https://arxiv.org/abs//2410.18588 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: http…

1
Knowledge Distillation Using Frontier Open-Source LLMs: Generalizability and the Role of Synthetic Data 19:45

5d ago19:45

19:45

This study explores knowledge distillation from Llama-3.1-405B to smaller models, demonstrating improved accuracy and efficiency through synthetic data and diverse evaluation methods across various tasks. https://arxiv.org/abs//2410.18588 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: http…

1
[QA] Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers 8:09

6d ago8:09

8:09

This paper explores how Rotary Positional Embeddings (RoPE) affect Transformer model dynamics, introducing phase shifts that influence embeddings, information retention, and attention through oscillatory behaviors and frequency components. https://arxiv.org/abs//2410.18067 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com…

1
Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers 20:50

6d ago20:50

20:50

This paper explores how Rotary Positional Embeddings (RoPE) affect Transformer model dynamics, introducing phase shifts that influence embeddings, information retention, and attention through oscillatory behaviors and frequency components. https://arxiv.org/abs//2410.18067 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com…

1
[QA] ALTA: Compiler-Based Analysis of Transformers 7:29

6d ago7:29

7:29

ALTA is a new programming language and compiler that maps programs to Transformer weights, enabling loop expression and improved algorithm representation, while providing tools for analyzing training challenges. https://arxiv.org/abs//2410.18077 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcast…

1
ALTA: Compiler-Based Analysis of Transformers 22:56

6d ago22:56

22:56

ALTA is a new programming language and compiler that maps programs to Transformer weights, enabling loop expression and improved algorithm representation, while providing tools for analyzing training challenges. https://arxiv.org/abs//2410.18077 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcast…

1
[QA] UnStar: Unlearning with Self-Taught Anti-Sample Reasoning for LLMs 8:06

7d ago8:06

8:06

This paper introduces UNSTAR, a novel unlearning method for large language models using anti-samples to efficiently and selectively reverse learned associations, enhancing privacy and model modification capabilities. https://arxiv.org/abs//2410.17050 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Po…

1
UnStar: Unlearning with Self-Taught Anti-Sample Reasoning for LLMs 16:43

7d ago16:43

16:43

This paper introduces UNSTAR, a novel unlearning method for large language models using anti-samples to efficiently and selectively reverse learned associations, enhancing privacy and model modification capabilities. https://arxiv.org/abs//2410.17050 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Po…

1
[QA] Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing 7:48

7d ago7:48

7:48

This paper explores how Knowledge Editing algorithms can unintentionally distort model representations, leading to decreased factual recall and reasoning abilities, a phenomenon termed "representation shattering." https://arxiv.org/abs//2410.17194 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podca…

1
Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing 18:06

7d ago18:06

18:06

This paper explores how Knowledge Editing algorithms can unintentionally distort model representations, leading to decreased factual recall and reasoning abilities, a phenomenon termed "representation shattering." https://arxiv.org/abs//2410.17194 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podca…

1
Catching Rockets, Self-Driving Taxis, and Supercomputers: Elon Musk's Vision 57:19

8d ago57:19

57:19

In this eye-opening episode of Generation AI, we dive into Elon Musk's game-changing breakthroughs that are reshaping our future. From SpaceX's Starship catching rockets mid-air to Tesla's steering wheel-free robotaxis, and xAI's record-breaking supercomputer built in just 19 days, we explore how these innovations are pushing the boundaries of what…

1
[QA] Generative Reward Models 7:10

8d ago7:10

7:10

The paper proposes GenRM, a hybrid approach combining RLHF and RLAIF, improving synthetic preference labels' quality and outperforming existing models in both in-distribution and out-of-distribution tasks. https://arxiv.org/abs//2410.12832 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: htt…

1
Generative Reward Models 12:09

8d ago12:09

12:09

The paper proposes GenRM, a hybrid approach combining RLHF and RLAIF, improving synthetic preference labels' quality and outperforming existing models in both in-distribution and out-of-distribution tasks. https://arxiv.org/abs//2410.12832 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: htt…

1
Trade versus Academic Press: Part 2 of Publishing in Academia

8d ago

—

This bonus content is a reading from Platypus, the CASTAC Blog. The full post by Savannah Mandel can be read at https://blog.castac.org/2024/10/trade-versus-academic-press-part-2-of-publishing-in-academia/. About the post: The decision between the two publishers was not simple. It was financial. It was personal. It was intellectual. It was also ide…

1
Episode 35: GETTING THE READER FROM BEGINNING TO END, WITH MERVE EMRE 59:20

9d ago59:20

59:20

A conversation with Shapiro-Silverberg Professor of Creative Writing and Criticism at Wesleyan University and contributing writer to The New Yorker magazine, Merve Emre. We talk about the work and goals of a book critic; what it means to think about the reader’s experience of our writing; creating a community of readers; and what it’s like to be ed…

1
[QA] Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks 8:07

9d ago8:07

8:07

This paper presents an AI agent for error resolution in computational notebooks, enhancing bug-fixing capabilities while evaluating user experience and collaboration within the JetBrains Datalore service. https://arxiv.org/abs//2410.14393 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: http…

1
Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks 10:28

9d ago10:28

10:28

This paper presents an AI agent for error resolution in computational notebooks, enhancing bug-fixing capabilities while evaluating user experience and collaboration within the JetBrains Datalore service. https://arxiv.org/abs//2410.14393 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: http…

1
[QA] Decomposing The Dark Matter of Sparse Autoencoders 7:58

9d ago7:58

7:58

This study explores "dark matter" in sparse autoencoders, revealing that much unexplained variance can be predicted and proposing methods to reduce nonlinear error in model activations. https://arxiv.org/abs//2410.14670 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.…

1
Decomposing The Dark Matter of Sparse Autoencoders 15:36

9d ago15:36

15:36

This study explores "dark matter" in sparse autoencoders, revealing that much unexplained variance can be predicted and proposing methods to reduce nonlinear error in model activations. https://arxiv.org/abs//2410.14670 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.…

1
Chief Jason Armstrong's Vision for Modern Law Enforcement 54:22

10d ago54:22

54:22

Hey there! Send us a message. Who else should we be talking to? What topics are important? Use FanMail to connect! Let us know! The CopDoc Podcast Season 6 - Episode 140 Join us on a journey as we chat with Chief Jason Armstrong from the Apex Police Department in North Carolina, a leader who has been reshaping the face of law enforcement. Jason's p…

1
[QA] A Hitchhiker's Guide to Scaling Law Estimation 10:08

10d ago10:08

10:08

The paper analyzes scaling laws in machine learning, providing best practices for estimating model performance using a large dataset of pretrained models and emphasizing the importance of intermediate training checkpoints. https://arxiv.org/abs//2410.11840 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Ap…

1
A Hitchhiker's Guide to Scaling Law Estimation 17:28

10d ago17:28

17:28

The paper analyzes scaling laws in machine learning, providing best practices for estimating model performance using a large dataset of pretrained models and emphasizing the importance of intermediate training checkpoints. https://arxiv.org/abs//2410.11840 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Ap…

1
[QA] Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations 7:39

10d ago7:39

7:39

This paper presents a novel method for image inversion and editing using rectified flow models, achieving superior performance in zero-shot tasks compared to existing diffusion model approaches. https://arxiv.org/abs//2410.10792 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcas…

1
Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations 10:29

10d ago10:29

10:29

This paper presents a novel method for image inversion and editing using rectified flow models, achieving superior performance in zero-shot tasks compared to existing diffusion model approaches. https://arxiv.org/abs//2410.10792 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcas…

1
[QA] Looking Inward: Language Models Can Learn About Themselves by Introspection 7:28

11d ago7:28

7:28

The paper explores whether large language models (LLMs) can introspect, finding that finetuned models can predict their own behavior, suggesting a form of internal knowledge access. https://arxiv.org/abs//2410.13787 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/…

1
Looking Inward: Language Models Can Learn About Themselves by Introspection 26:21

11d ago26:21

26:21

The paper explores whether large language models (LLMs) can introspect, finding that finetuned models can predict their own behavior, suggesting a form of internal knowledge access. https://arxiv.org/abs//2410.13787 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/…

1
[QA] Thinking LLMs: General Instruction Following with Thought Generation 7:25

11d ago7:25

7:25

The paper proposes a method to enhance LLMs' thinking abilities for better instruction following, improving performance across various tasks without additional human data through iterative search and optimization. https://arxiv.org/abs//2410.10630 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podca…

1
Thinking LLMs: General Instruction Following with Thought Generation 15:52

11d ago15:52

15:52

The paper proposes a method to enhance LLMs' thinking abilities for better instruction following, improving performance across various tasks without additional human data through iterative search and optimization. https://arxiv.org/abs//2410.10630 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podca…

1
[QA] Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs 7:44

12d ago7:44

7:44

The paper investigates extreme-token phenomena in transformer-based LLMs, revealing mechanisms behind attention sinks and proposing strategies to mitigate their impact during pretraining. https://arxiv.org/abs//2410.13835 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.appl…

1
Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs 17:44

12d ago17:44

17:44

The paper investigates extreme-token phenomena in transformer-based LLMs, revealing mechanisms behind attention sinks and proposing strategies to mitigate their impact during pretraining. https://arxiv.org/abs//2410.13835 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.appl…

1
[QA] MOVIE GEN: A Cast of Media Foundation Models 8:52

12d ago8:52

8:52

https://arxiv.org/abs//2410.13720 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/supp…

1
MOVIE GEN: A Cast of Media Foundation Models 1:53:06

12d ago1:53:06

1:53:06

https://arxiv.org/abs//2410.13720 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/supp…

1
[QA] One Step Diffusion via Shortcut Models 8:06

13d ago8:06

8:06

https://arxiv.org/abs//2410.12557 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/supp…

Podcasts, die es wert sind, gehört zu werden

Academic Agent Podcasts

Podcasts, die es wert sind, gehört zu werden

Kurzanleitung