Homework 1 - Computer Action Team

Homework 1 - Computer Action Team

Homework 1 (with additional explanations) Intelligent Robotics 1, ECE 478/578 Deadline, October 15 This Homework is Group Project Will be incorporated into your final project About Homework 1 for all students 1. 2. Students who work with Richard Armstrong on Mr. Jeeves are not required to do these homeworks. You discuss all your mini-projects with Rick. 1. 2. 3. 4. Two homeworks are mandatory for all other students. Because of additional Intel Projects, the homework deadlines will be extended. You work in your initial teams or teams of your choice. You can use work of other students as part of your project but you must specifically mention it. 5. I am grading based on results and not good will of a student. First two phases of Homework 1 are mandatory Third first of Homework 1 is for volunteers only. In this homework 1 you will learn: 1. 2. 3. 4. 5. Use of Kinect The concept of state machine in robotics. The concept and use of fuzzy logic in robotics Using Powerpoint for scenario prototyping. Dialogs with robots.

Explanation to the first phase of Homework 1 1. Create Powerpoint presentation with effects, figures, pictures, videos, etc A) Presentation about Copernicus for those in Copernicus group B) Presentation about Frankenstein Monster and PSU for those in Monster Group and in stage design group. C) Presentation with the Quantum Debate play for those in Quantum Debate Play robots (Einstein, Newton, Marie Curie, Cat and Bohr). 2. These slides can be done with jumps and transitions, as in my PPT slides demonstrated in class, but must have better effects and be more theatrical. Record your voice we need more male voices. These voices and other sounds should be incorporated into the PPT presentation. 3. Add questions and answers in Romanian, Spanish, Russian, Chinese, Indian, etc. (we have Latin and German already). Do not spend too much time, do this only if you are familiar with these languages. 4. Use Kinect-based control of PPT slides software from my class and/or from internet. 5. See the separate files for explanation of this software. the first phase of Homework 1 Human gestures Kinect Kinect processing software (exist) Pressing PPT button slide Convert to PPT instruction (exist) PPT

effects sounds Explanation to the SECOND phase of Homework 1 1. Complete and test the first phase. 2. Create a state machine that describes the behavior of the robot, robots or/and the entire theatre presentation. 3. This machine can be deterministic, probabilistic of fuzzy. Or mixed. It can have several machine communicating with one another. It can be programmed in any language. 4. The entire system can be written in any language of your choice, or mixture of languages. It should use PPT, and Kinect software. 5. The block-diagram of the system is shown in next slide. 6. Next three slides present some variants of the state machine. You are not restricted to them. You can create arbitrary state machine. 7. Additional slides demonstrate fuzzy and other state machines for a robot. 8. Videotape your work. Write a document report.

Complete software for the second phase of the Homework 1 (minimum variant) Human gestures Kinect Kinect processing software (exist) Simulation of pressing PPT button slide Convert to PPT instruction (exist) PPT effects sounds Simulation of pressing PPT button State machine that describes the entire behavior of the robot and slides Part in pink is new. It can be written in any language, perhaps the easiest is to use the same

language in which Kinect Processing and conversion was written (color grey) Fuzzy logic, Boolean Logic, Probabilistic logic Action of the robot (signals to motors) Feedback loop Memory, fuzzy of boolean Additional explanation 1. Observe that the only input to a robot is Kinect. 2. Thus the robot is controlled by one or more of the following a. b. c. d. e. f. g. h. i. Human gestures with arms Human gestures with skeleton Human pressing buttons or using any mechanical interface Position of other robots as seen on Kinect. Position of people as seen by Kinect Quality of human motion in exercise, as evaluated by some objective criteria Any other idea taken from literature about uses of Kinect. Any of your ideas, be creative.! The robot can be physical : a. b. c.

j. any robot in the lab, Lego robot on your own, what you want. The robot can be simulated : a. b. Simple ad hoc graphics like in Robo-Logo or Lego, turtle graphics. Any existing software for simulating andvanced robots (needs some simple integration). Simplified State Machines of robot plays M2. State Machine of Regular Linear play M1. State Machine of Copernicus Initial slide with questions Question button Clear button Answer to last question Slide with answer to question 1 Slide with answer to second question This is model of simple linear play like in standard

theatre and Great Quantum Debate play Combined M1 and M2. Answer to a question is a Regular Linear play Initial slide with questions Question button This is model of simple question answering Answer to last question Slide with answer to question 1 Other combinations are of course possible Slide with last behavior Slide with behavior 3 Slide with behavior 2 Slide with behavior 1 Slide with answer to second question

This is model of simple question answering Slide with behavior 1 Slide with behavior 2 Slide with behavior 3 Slide with last behavior Simplified State Machines of robot plays M2. State Machine of Regular Linear play M1. State Machine of Copernicus Initial slide with questions Question button Clear button Answer to last question Slide with answer to question 1

Slide with answer to second question This is model of simple linear play like in standard theatre and Great Quantum Debate play Combined M1 and M2. Answer to a question is a Regular Linear play Initial slide with questions Question button This is model of simple question answering Answer to last question Slide with answer to question 1 Other combinations are of course possible Slide with last behavior Slide with behavior 3 Slide with behavior 2 Slide with behavior 1

Slide with answer to second question This is model of simple question answering Slide with behavior 1 Slide with behavior 2 Slide with behavior 3 Slide with last behavior Simplified State Machine of interactive robot play M3. State Machine with interaction (similar to one explained in class for Paradise Lost) The decision variables are inputs, for instance from sensors or from pressing PPT buttons This is equivalent to Finite State Machine or general Flowchart Slide with behavior 2

Slide with behavior 1 Slide with behavior 3 Decision Node Question A Negative answer Positive answer Behavior $r Behavior 1 Decision for input variable B Negative answer Positive answer Slide with behavior 2 Slide with behavior 3 Slide with behavior 4 Slide with

last behavior Remarks 1. There are many people working on the same part of homework (like all people from Copernicus team) 2. The homeworks for all students (Copernicus team, quantum debate teams and Monster team) in the class are quite similar. 3. Software for Kinect exists and can be also found in internet. 4. Partial credit will be given for partial solutions. 5. Creativity will be rewarded. 6. Ask me questions if not clear. Explanation of the third phase of Homework 1 (NOT MANDATORY) Additional work for people who already work on projects (not required now, but will count for the next homework and your project) 1. Assume any robot from the lab, it can be particularly your robot from your project (this would save you time later on). 2. The robot must have some input(s) other than KINECT. This can be touch sensors, sonars, light sensors, etc. Your choice. 3. The robot should have some effectors. 4. It can be a Lego robot of your design. See my slides. 5. The robots architecture can be any architecture discussed so far in our class, for instance a Braitenberg Vehicle.

6. The robot behavior is changed by gestures from KINECT. For instance, you can use your hand gestures or facial gestures to change the behavior of a Braitenberg Robot from Aggressive to Shy. 7. All your work should be videotaped. Complete software for the additional work for the Homework 1 Human gestures Kinect processing software (exist) Kinect Simulation of pressing PPT button slide Convert to PPT instruction (exist) PPT effects sounds Simulation of pressing PPT button Physical inputs of the

robot (from sensors of human controls, or gestures from Kinect) More inputs Fuzzy logic, Boolean Logic, Probabilistic logic Action of the robot (signals to motors) Feedback loop Memory, fuzzy of boolean List of useful documents on this page for Week2 1. 2. 3. 4. 5. 6. Scripts of plays and conversations. Report about KINECT to PPT interface done in our class. Other reports about KINECT to PPT interfaces. Other reports about controlling robots with KINECT. Class material about fuzzy logic. Material (PPT slides and text) about using a simple quantum(probabilistic) control of a Braitenberg robot in RobotC language.

Recently Viewed Presentations

  • /www.pitt.edu/~super Conferencia Justo-enTiempo (JIT) Huracn Ali Ardalan, Ronald

    /www.pitt.edu/~super Conferencia Justo-enTiempo (JIT) Huracn Ali Ardalan, Ronald

    www.pitt.edu/~super/ Conferencia Justo-en-Tiempo (JIT) Huracán Ali Ardalan, Ronald E. LaPorte, Eugene Shubnikov, Faina Linkov, Mehdi Russel & Eric K. Noji
  • Skærpet overvågning eller beskyttelse af forskningsmiljøet?

    Skærpet overvågning eller beskyttelse af forskningsmiljøet?

    De påtænkte foranstaltninger og deres mulige virkning Praksisudvalgets 'frihedsbrev' til at tilrettelægge sagsbehandlingen (indtil ledelsen evt. trækker delegationen tilbage) SUNDs 'særligt udpegede person': den åndelige leder mht god praksis i forskningshverdagen Håbet om at komme hurtigt frem til den substantielle...
  • Meiosis - Oikos

    Meiosis - Oikos

    Slide show modified from Kelly Riedell, Tracy Jackson and Kim Foglia ... MEIOSIS is the way… to make cells (gametes) with ½ the number of chromosomes for sexual reproduction DIPLOID Most cells have 2 copies of each chromosome = _____...
  • Probability Distributions Random Variable A random variable x

    Probability Distributions Random Variable A random variable x

    Expected value, or mean If we understand the underlying probability function of a certain phenomenon, then we can make informed decisions based on how we expect x to behave on-average over the long-run…(so called "frequentist" theory of probability). Expected value...
  • Financial Sustainability: Small Rural Clinics

    Financial Sustainability: Small Rural Clinics

    Participants will identify two contemporary issues in integrated behavioral health care. Participants will identify two ways to overcome the constraints and concerns of rural integrated care practice. Participants will discuss and create pathways to enhance accessibility to integrated behavioral health...
  • The Value of Coins Dr. Beth McCulloch Vinson

    The Value of Coins Dr. Beth McCulloch Vinson

    When you get to the pennies say "twenty-one", etc. = Quarter One dime and 3 nickels equal a quarter. = Quarter Count the dime and nickels. 15 20 10 25 = 25 cents Quarter Two dimes and 1 nickel equal...
  • The Evolving Scholarly Record: ranking and reputation

    The Evolving Scholarly Record: ranking and reputation

    The Evolving Scholarly Record: ranking and reputation. Several people have asked if I will be summarizing discussions of the last several days. I will not - they defy easy synthesis and I'm not sure it was even Ricky's intent to...
  • Coerced Cache Eviction and Discreet Mode Journaling: Dealing ...

    Coerced Cache Eviction and Discreet Mode Journaling: Dealing ...

    This is currently implemented on HFS, MS-DOS (FAT), and Universal Disk Format (UDF) file systems. The operation may take quite a while to complete. Certain FireWire drives have also been known to ignore the request to flush their buffered data.