Siwei Zhang, Bharat Lal Bhatnagar, Yuanlu Xu, Alexander Winkler, Petr Kadlecek, Siyu Tang and Federica Bogo propose RoHM, an approach for robust 3D human motion reconstruction from monocular RGB(-D) videos in the presence of noise and occlusions.

In this course, Jason Liu, author of the Instructor library, teaches how to improve LLM engineering skills. Learn about structured JSON output handling, function calling, complex validations with Pydantic and more.

Zhen Li, Mingdeng Cao, Xintao Wang, Zhongang Qi, Ming-Ming Cheng and Ying Shan present PhotoMaker, an efficient personalized text-to-image generation method that encodes an arbitrary number of input ID images into a stacked ID embedding for preserving ID information, allowing for high-quality, identity-preserving human photo ...

VIDEO | Fascinating video explaining how a teenager "broke" Tetris, but also how the community found out that it was even possible and how this became a goal in itself

VIDEO | Johann Rehberger discusses real-world exploits in Large Language Model applications, including ChatGPT, Bing Chat, and Google Bard. He highlights three categories of threats and focuses on indirect prompt injections, demonstrating with examples and a Bing Chat demo. The talk also covers injection TTPs and data exfiltr...

Derong Xu, Wei Chen, Wenjun Peng, Chao Zhang, Tong Xu, Xiangyu Zhao, Xian Wu, Yefeng Zheng and Enhong Chen explore the recent advancements in information extraction using generative Large Language Models (LLMs). They categorize the works based on various subtasks and learning paradigms and empirically analyze the most advance...

Jan Van Haaren shares his annual review of soccer analytics content, featuring research papers, blog posts, news articles, podcasts, and code repositories that provide new insights, address challenges, propose methods or apply existing methods in a creative way.

Boris Larin presents Operation Triangulation, a sophisticated 0-click iMessage attack using four zero-days, targeting iOS versions up to 16.2. The attack chain involves exploiting a remote code execution vulnerability in the ADJUST TrueType font instruction and bypassing hardware memory protection to gain full control over th...

Penghao Wu and Saining Xie introduce V*, an LLM-guided visual search mechanism that enhances collaborative reasoning, contextual understanding, and precise targeting of specific visual elements in multimodal large language models. When combined with an MLLM, this mechanism forms a new MLLM meta-architecture called SEAL.

Like every year since 2021, Microsoft publish their Future of Work report for 2023. This year’s edition centers on research related to integrating LLMs into work

Future Crunch - Angus Hervey shares 66 good news stories from 2023, including progress in healthcare, climate change, and education.

Panda Smith discusses the limitations of vector databases and suggests that building a good search engine is a better approach for creating language model-powered documentation tools. He offers insights into improving overall search by blending embeddings with more traditional methods, and using language models to structure q...

Ars Technica - Extreme E, the electric off-road series, plans to switch to hydrogen in 2025. Founder and chairman Alejandro Agag aims for Extreme H to be the first pure hydrogen world championship racing

Nature - Bernardino Romera-Paredes, Mohammadamin Barekatain, Alexander Novikov, Matej Balog, M. Pawan Kumar, Emilien Dupont, Francisco J. R. Ruiz, Jordan S. Ellenberg, Pengming Wang, Omar Fawzi, Pushmeet Kohli and Alhussein Fawzi introduce FunSearch, a method using a pre-trained LLM and systematic evaluator to make mathemati...

This tutorial, written by Jason Liu, demonstrates how to perform bulk text classification using user-provided tags with the Instructor library and OpenAI's API. It covers defining tag structures, implementing classification, and improving the model.

Zi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Yan-Pei Cao and Song-Hai Zhang propose a novel transformer-based approach for single-view 3D reconstruction. The method uses two decoders: a point decoder to generate point clouds and a triplane decoder to query Gaussian features for each point. This hybrid repr...

Shuyang Sun, Runjia Li, Philip Torr, Xiuye Gu and Siyang Li propose a novel recurrent framework for open-vocabulary image segmentation using CLIP (Contrastive Language-Image Pretraining). Their approach progressively filters out irrelevant texts and enhances mask quality without training efforts, resulting in state-of-the-art...

This paper presents the findings of the BabyLM Challenge, which focuses on sample-efficient pretraining on developmentally plausible corpora.

Apple Researchers Keivan Alizadeh, Iman Mirzadeh, Dmitry Belenko, Karen Khatamifard, Minsik Cho, Carlo C Del Mundo, Mohammad Rastegari, and Mehrdad Farajtabar present a method for efficiently running large language models on devices with limited DRAM capacity

WHAM, a method developed by Soyong Shin, Juyong Kim, Eni Halilaj, and Michael J. Black, accurately and efficiently reconstructs 3D human motion in a global coordinate system from video. It outperforms existing methods across multiple benchmarks.

Researchers from the GrapheneX-UTS Human-centric Artificial Intelligence Centre have developed a portable, non-invasive system that can decode silent thoughts and turn them into text.

NewScientist - Researchers at Indiana University Bloomington have developed a biocomputing system that uses living brain cells to perform speech recognition, achieving an accuracy of 70-80% after training. The system, called 'Brainoware', consists of brain organoids grown from stem cells and placed on top of a microelectrode ...

Agrim Gupta, Lijun Yu, Kihyuk Sohn, Xiuye Gu, Meera Hahn, Li Fei-Fei, Irfan Essa, Lu Jiang and José Lezama present W.A.L.T, a transformer-based approach for photorealistic video generation via diffusion modeling, achieving state-of-the-art performance on established benchmarks.

Omar Sanseviero, Lewis Tunstall, Philipp Schmid, Sourab Mangrulkar, Younes Belkada, and Pedro Cuenca, explain the concept of Mixture of Experts (MoEs), a class of models that enable efficient pretraining with large model sizes or datasets by replacing dense feed-forward network layers with sparse MoE layers composed of multip...

Alibaba present, DreaMoving, a diffusion-based controllable video generation framework, produces high-quality customized human videos.