ease:workshop
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | |||
| ease:workshop [2020/09/01 08:17] – hawkin | ease:workshop [2020/09/01 09:55] (current) – added video to intriduction hawkin | ||
|---|---|---|---|
| Line 4: | Line 4: | ||
| ==== Abstract ==== | ==== Abstract ==== | ||
| In order to enable robots to perform every day activities with ease, they need to know when to do what. And who could be a better teacher then the human who wants the robots to perform these tasks? But instead of having us humans explain to the robots what to do, it is easier to just show them in a Virtual Reality environment, | In order to enable robots to perform every day activities with ease, they need to know when to do what. And who could be a better teacher then the human who wants the robots to perform these tasks? But instead of having us humans explain to the robots what to do, it is easier to just show them in a Virtual Reality environment, | ||
| + | |||
| + | In the following video we can see how a human performs everyday activities within the VR environment. | ||
| + | |||
| + | < | ||
| + | <div style=" | ||
| + | < | ||
| + | </ | ||
| + | |||
| Before we can teach the robots though, we have to understand what kind of data is being recorded and how we can access and inspect it, before we decide which parts of it to pass on to the robots. | Before we can teach the robots though, we have to understand what kind of data is being recorded and how we can access and inspect it, before we decide which parts of it to pass on to the robots. | ||
| This tutorial will aim at teaching how to interact with episodic memories and inspect the data stored within using [[http:// | This tutorial will aim at teaching how to interact with episodic memories and inspect the data stored within using [[http:// | ||
| Line 10: | Line 18: | ||
| ==== Introduction ==== | ==== Introduction ==== | ||
| We can record everything the human does in a Virtual Reality environment fairly precisely. The position of the head of the human can be tracked by tracking the headset itself, while the position of the hands can be mapped to the position of the joysticks. | We can record everything the human does in a Virtual Reality environment fairly precisely. The position of the head of the human can be tracked by tracking the headset itself, while the position of the hands can be mapped to the position of the joysticks. | ||
| - | |||
| - | :!: '' | ||
| Every interaction between the hands of the human with the virtual environment is recorded. We can replay these recordings (episodes) and inspect them, learning from them how a human does a certain everyday activity. Why do we do tasks in a specific order? (For instance, in a table setting scenario most people would put the plate down first and then get the cutlery.) How do we place objects? What orientation of objects do we tend to prefer? | Every interaction between the hands of the human with the virtual environment is recorded. We can replay these recordings (episodes) and inspect them, learning from them how a human does a certain everyday activity. Why do we do tasks in a specific order? (For instance, in a table setting scenario most people would put the plate down first and then get the cutlery.) How do we place objects? What orientation of objects do we tend to prefer? | ||
| - | :!: '' | ||
| All of these things are small subconscious decisions we are not necessarily aware of since we are just used to do things a certain way. How should a robot know them? This is where episodic memories come in. We can use the recorded data from Virtual Reality to teach robots to do everyday activities without having to hard code every small little detail into the program of the robot (at least that's the goal). Before we can get there though, we need to understand and see how the data is stored, what we can learn from it, and what information can be obtained in the first place. | All of these things are small subconscious decisions we are not necessarily aware of since we are just used to do things a certain way. How should a robot know them? This is where episodic memories come in. We can use the recorded data from Virtual Reality to teach robots to do everyday activities without having to hard code every small little detail into the program of the robot (at least that's the goal). Before we can get there though, we need to understand and see how the data is stored, what we can learn from it, and what information can be obtained in the first place. | ||
| - | :!: '' | ||
| ==== Tutorials ==== | ==== Tutorials ==== | ||
ease/workshop.1598948237.txt.gz · Last modified: 2020/09/01 08:17 by hawkin