Microsoft will use ChatGPT to control robots via language

Microsoft says that ChatGPT might be used to convert a human-language description

Microsoft Autonomous Systems and Robotics Group researchers have demonstrated how OpenAI's ChatGPT may be used for robotics applications, including how to build prompts and how to instruct ChatGPT to use particular robotic libraries to program the task at hand. According to Microsoft's developers, modern robotics is based on a close feedback loop between a robot and an engineer who is in charge of programming the task, monitoring the robot's behavior, and making adjustments by writing new code.

According to Microsoft, ChatGPT might be used to convert a human-language description of the operation to be carried out into robot-friendly code. This would enable the engineer to be replaced (in the loop) by a non-technical user (on the loop), who would only be tasked with providing the original task description in human language, supervising the robot, and providing any feedback regarding the robot's behavior (again in human language), which ChatGPT would then translate into code to modify the behavior.

Microsoft researchers developed a number of case studies utilizing their experimental methodology, including object manipulation using a robotic arm, object detection using object distance APIs, and zero-shot task planning to guide a drone to investigate the contents of a shelf.