What is the way to go in hobby robotics today? I'm more interested in high level, and want the lower level to 'just work' with minimum efforts from my side. Having mechanical part and vision what would be the right choice for low-middle software to control robotic arm and car, may be attached one to another. ROS2?

▲

ratsbane 8 months ago | parent | next [-]

HuggingFace LeRobot. You can build the reference arm easily and cheaply and the software is designed to train AI. There's a lot to explore and extend there and the community is growing rapidly. It's based on the Stanford Aloha project. https://huggingface.co/lerobot

▲

tomp 8 months ago | parent [-]

LeRobot is 6DoF.

How much does this matter in practice vs 7DoF arm?

	▲	ratsbane 8 months ago \| parent [-]
		Probably not much. Also the LeRobot reference arm (SO-ARM100) is 6DoF, but it's very hackable and there are already project with different grippers, etc.

▲

pryelluw 8 months ago | parent | prev | next [-]

I’d say start with a sumo robot, line follower, or maze solver. That’ll keep you very entertained for a good while.

▲

MoonGhost 8 months ago | parent [-]

Thanks, but no. It's going to be robotic arm with gripper and camera. The rest can be either Raspberry Zero (for cam, control, with net or blutooth, something big for high level). Another option, not exclusive, NVidia Jetson Nano instead of Zero. It could be Raspberry Pi 3, but I don't want to do video processing on it. All this I have, just need to put them together. Adding AGX Orin will be a big thing. That's actually the goal. With video processing and LLM all in one mobile robot. As it's hobby R/D it will be configured and reconfigured many times. That's why I don't want to do low level by hand every time.

Another interesting option is Raspberry Pico * N + Tiny PC. For control and thinking. They can be connected via wifi or blutooth.

▲

sadhorse 8 months ago | parent [-]

What kind of vision peocessing are you envisioning?

	▲	MoonGhost 8 months ago \| parent [-]
		3D reconstruction, from stereo or mono camera, have both. Object detection, text reading. Ideally it should recognize the speaker, simple gestures. Take audio, feed speech to LLM, get the output. Being able to detect and move out of the way of walking humans. Most of it has been done, like 3d structure and localization from motion. There are reference implementations. I've done it before too. It's sort of open ended project. Having LLM with vision on mobile robot with arm.. has a lot of applications. AGX Orin 64GB is capable of running serious models.

▲

ww520 8 months ago | parent | prev [-]

Micro mouse is a good way to get into robotic.