menloresearch

fees to the only owner of the github organization github.com/thinhlpg github.com/menloresearch This will be the first humanoid robot consumers can have and we've never ran it properly with fees t.co

Building an Open-Source Humanoid | Yip Jia Qi, Menlo Research | Φ Podcast Ep 2 What does it take to build a humanoid that anyone can download, repair and change? Φ sat down with Yip Jia Qi, lead research engineer at Menlo Research, the lab behind Asimov, an open-source humanoid, and the Kepler encoder. Jia Qi came to robots from PhD research in speech and audio. He joined Menlo to put a voice agent inside a robot, and first had to help build the robot. We get into why Asimov is open source, what zero-shot sim-to-real really took, how Cyclotron trains walking with AMP, robots that improve their own skills and their own bodies, imitation learning versus RL, Kepler and the case for one shared encoder, why touch is so hard, and how you test and deploy a humanoid. Then rapid fire, and three predictions we will check next year. Hosted by Yashvardhan Gupta and Parv Patodia. CHAPTERS 0:00 Intro 0:36 From speech research to building robots 3:07 Asimov, and why open-source a humanoid 6:21 Zero-shot sim-to-real: it comes down to the actuator 16:25 Cyclotron, AMP vs PPO, and why RL feels like gambling 20:53 Vision: stairs, LiDAR, and a head you can replace 29:11 Self-improving robots: new skills, then new bodies 36:19 Imitation learning vs RL: the final boss 40:54 Kepler: one encoder, many senses, many models 50:04 Why force and touch are hard to give a robot 54:09 Asymmetric cross-attention, the Perceiver, and JEPA 1:00:44 Evaluation: a fitness test for robots 1:03:40 Deployment: why onboarding is the data that matters 1:07:39 Can a robot hear that something is wrong? 1:10:33 Rapid fire 1:16:15 Predictions: robots in homes, and robots that pay tax 1:19:06 Can we solve robotics this time? MENTIONED IN THIS EPISODE Asimov 1, the open-source humanoid: menloresearch/asimov-1 How we achieved zero-shot sim2real for Asimov: menlo.ai Noise is all you need to bridge the sim-to-real locomotion gap: menlo.ai Cyclotron: menloresearch/cyclotron Menlo SDK: menloresearch/menlo-sdk AMP, Adversarial Motion Priors: arxiv.org Kimodo: research.nvidia.com SONIC: nvlabs.github.io Kepler-Encoder v0.1: arxiv.org ACA-Net: arxiv.org Perceiver: arxiv.org Perceiver IO: arxiv.org LeJEPA (SIGReg): arxiv.org MolmoBot: arxiv.org GUEST Yip Jia Qi: linkedin.com ABOUT Φ Φ (Physical Hardware Intelligence) is a robot learning lab in Silicon Valley. We build on the SO-101 arm and share everything we learn. physical-hardware-intelligence.github.io

Day 363 of building Asimov 1. Testing new grippers so it can pick things up and work with them! Adding grippers to Asimov 1. The arms have been strong enough for a while. Now it’s time to use them for manipulation! Quick note, if you’re seeing Asimov 1 for the first time, it's a fully open-source humanoid robot built from off-the-shelf parts, so you can build one yourself. menloresearch/asimov-1

Beyond the Screen: Build Your Own Humanoid with Asimov 1! --- title: Beyond the Screen: Build Your Own Humanoid with Asimov 1! published: True tags: humanoid, open, robotics, diy --- Quick Summary: 📝 Asimov 1 is an open-source, 1.2m tall, 35kg humanoid robot with 25 actuated degrees of freedom. This repository provides the necessary mechanical CAD, electrical CAD, simulation models, and onboard software for users to build, simulate, and customize their own Asimov 1 robot. Key Takeaways: 💡 - ✅ Asimov 1 is a 1.2m tall, 25-DOF open-source humanoid robot that developers can build and customize. - ✅ All mechanical CAD, electrical schematics, simulation models, and onboard software are freely available under open licenses. - ✅ Developers have two options to build: purchase a DIY kit or self-source all components and fabricate parts themselves. - ✅ It's an excellent platform for hands-on learning in robotics, AI integration, motion control, and hardware customization. - ✅ The project fosters a strong community, making advanced robotics accessible and collaborative for enthusiasts. Project Statistics: 📊 - ⭐ Stars: 1312 - 🍴 Forks: 224 - ❗ Open Issues: 2 Tech Stack: 💻 - ✅ Python Ever dreamed of having your own humanoid robot? The kind you see in sci-fi movies, walking, interacting, and learning? For a long time, advanced robotics felt like something locked away in research labs or massive corporations. But guess what? The future is here, and it's open-source! I'm incredibly excited to share Asimov 1, a groundbreaking project that lets developers like us not just tinker with, but actually build, train, and customize a full-fledged humanoid robot. Asimov 1 isn't just a concept; it's a tangible, 1.2-meter tall, 35kg bipedal robot packed with 25 actuated degrees of freedom. Think of it as a highly sophisticated, human-like machine designed for a wide range of movements. It boasts 6 DOF in each leg for intricate locomotion, 5 DOF in each arm for dexterous manipulation (it can bicep curl 5kg!), a torso for balance, and a head equipped with a 2MP camera and stereo microphone array to perceive its surroundings. Its 'brain' combines a Raspberry Pi 5 for media and networking with a Radxa CM5 for precise motion control, giving it both high-level intelligence and real-time responsiveness. What truly makes Asimov 1 revolutionary is its completely open-source nature. Every single design file – from mechanical CAD and electrical schematics to the simulation model and onboard software – is freely available under open licenses (CERN-OHL-S-2.0 for hardware, GPL-2.0 for software). This transparency means you're not just buying a product; you're gaining access to an entire platform for learning and innovation. You can choose to get a convenient DIY kit with everything you need unassembled, or if you're feeling particularly adventurous, you can self-source all the components and fabricate parts yourself, following the comprehensive manual. For us developers, Asimov 1 is an absolute game-changer. Imagine the possibilities: it's an unparalleled platform for hands-on learning in robotics, from understanding inverse kinematics and motion planning to integrating advanced AI for computer vision and natural language processing. The open design means you have full control to modify, extend, and innovate. Want to add new sensors? Design custom end-effectors? Develop a unique locomotion policy? Asimov 1 empowers you to do it all. It's a robust foundation for academic research, personal projects, or even kickstarting your own robotics ventures. Plus, there's a thriving community on Discord and forums where you can connect with fellow builders, share insights, and get support. This project truly democratizes advanced robotics, making it accessible to anyone with the passion to build and innovate. Don't just dream about the future of robotics – build it! Learn More: 🔗 View the Project on GitHub --- 🌟 Stay Connected with GitHub Open Source! > 📱 Join us on Telegram > Get daily updates on the best open-source projects > GitHub Open Source > 👥 Follow us on Facebook > Connect with our community and never miss a discovery > GitHub Open Source

Asimov 1, an open-source humanoid with a Raspberry Pi 5 as its head Hi r/raspberry_pi, Emre from Menlo Research. We've been building Asimov 1, a humanoid robot made from off-the-shelf and 3D-printable parts, and we open-sourced everything we built. Its head runs on a Raspberry Pi 5, so I thought this would be a good place to share how we used it. Asimov 1 has 2 computers. A Radxa CM5 in the torso handles the walking, the actuators and the IMU. That loop is time-sensitive, so we kept everything else away from it and gave it to the Pi. The Pi 5 in the head runs the camera, the microphones and speaker, Wi-Fi and video streaming. It also serves the web console you open in a browser to set up, calibrate and drive the robot. The 2 computers talk over a 1 m Ethernet cable. A few Pi-specific things we ran into along the way: - The head stack is a head board under the Pi and a Media HAT on top, and the HAT is there partly to prevent Pi brownouts - The camera connects over USB, not CSI - The Pi has an RTC battery so it keeps time between power cycles - The Pi starts its own access point for setup, and the password is on the QR code on the Pi's box, so don't throw the box away Setup is the usual routine. Flash it with Raspberry Pi Imager, plug everything in, SSH in through the access point. Everything is open (really!), from the mechanical CAD and electrical schematics to the simulation files, SDK, locomotion policy and training code, so people can build on top of it. The bill of materials is public too, so you can source the parts yourself and build one. We're thinking about what else the Pi could take on, like on-device vision or local voice, and would love ideas from people who know the Pi better than we do. Feel free to check out the repo with all the open-source files: menloresearch/asimov-1 We're also putting together a user manual for people who want to source the parts and build their own humanoid: docs.menlo.ai Love to share a few demos soon, so let me know if you'd like to see them.

Building a humanoid for agentic robotics Agents are going to live with us, and the human form factor is the one that generalizes best in our world. So we've been heads down building a humanoid robot that agents can embody. A bit of back story. We started with a Unitree G1 last year to build an ecosystem allowing agents to control robot. It didn't work. G1 hardware is proprietary, the parts are custom and every repair goes through the manufacturers or resellers. We noticed that if agents are going to live in our homes, their bodies/robots should be built in a way they can understand every single part and easy to repair. We need to be able to fix them, change them and see what they run, including the safety layer. So we built Asimov 1 from off-the-shelf parts. With the bill of materials you can source the parts and build one yourself. Everything we built is open, the CAD, the SDK for communication, Edge for safety, the locomotion policy and the training code as a foundation for agents and people to build on top of. It's still early for agentic robotics. Asimov 1 walks, but there's a lot we haven't figured out yet and we're learning as we go. We'd rather do that in the open for agents and also with more people building alongside us. Planning to focus to agent layer now. If you've been thinking about building a robot, now is a good time. You can build your own, fork ours, or pick any open-source robot and push it further. The more open bodies there are, the faster agents will learn to live with us. The repo to build your own: menloresearch/asimov-1 We're also putting together a user manual for building your own humanoids robots from scratch: docs.menlo.ai Really appreciate to hear your thoughts on agentic robotics and Asimov 1.

You can train Asimov 1 using our open-source RL training framework, built on @NVIDIAAI's Isaac Lab. menloresearch/cyclotron

@rosario_scaling @octi_zhang asimov! menloresearch/cyclotron thats the one I'm training right now from @asimovinc

An IKEA-style manual for building an open-source humanoid robot (Asimov 1) Hi r/robotics, we're building Asimov 1, an open-source humanoid robot. Today we're sharing the updated version of Asimov 1 User Manual. It's a step-by-step guide that takes you from a bench full of parts to a robot that stands up and walks. It's with 3D visuals you can rotate and inspect in every assembly step. Asimov 1 is built by off-the-shelf parts, so you can source the components yourself and build one from scratch! We also made a little old-school film to go with it! - User Manual: docs.menlo.ai - GitHub: menloresearch/asimov-1 Happy to answer questions, and love feedback on the manual!

Menlo SDK is now open-source. - Turn your ideas into new capabilities for your Asimov 1 - Control its movements and read its state from your code - Use its camera, microphone and speaker in your applications Start building on humanoids: menloresearch/menlo-sdk