AI
CIMON SAYS… flies, feels, sees, hears, sings in space
April 28, 2020 | Written by: Anders Quitzau
Categorized: AI | Innovation | Technology
Share this post:
You may remember that I wrote about the CIMON, Watson AI-powered assistant that could help the astronauts in the International Space Station (ISS), to perform experiments and to socialize a little, too.
Now that was CIMON-1. CIMON-1 has retired and like any other astronaut, CIMON-1 will now spend his retirement, performing at events and in exhibitions, encouraging young people to study STEM and showing off his capabilities.
CIMON-2 was launched to ISS in December 2019, but what is CIMON really?
CIMON is a 3D-printed ball-shaped device with an AI inside, powered by IBM Watson. The task for CIMON is to support astronauts during long travels and stays in space. Not only with factual knowledge and instructions but also as a socializing, understanding, nice companion and entertainer.
CIMON-2 has successfully recently been tested by the Italian astronaut Luca Parmitano and demonstrated many of his capabilities:
- Indoor precision navigation using his new eyes – a stereo camera
- Autonomous flying, nodding, shaking his head with 12 internal rotors,
- Ultrasonic sensors to prevent collision
- Voice recognition and NLP for dialogues and understanding spoken commands
- 8 microphones for detecting the location of sound sources
- A ‘mouth’ in the form of loudspeaker for talking and playing music
- Access to a large knowledge base of the space, the experiment protocols, the mission, and the space station
CIMON is powered by Watson technologies including Watson Visual Recognition, Watson Speech to Text, Watson Text to Speech, Watson Assistant and Watson Tone Analyzer.
The tone analyzer enables Watson to understand the astronauts’ feelings and have an empathic dialogue. Is she/he stressed, in a bad mood, angry? Should CIMON say some calming words or perhaps music from someone’s favorite playlist?
DID YOU READ: THINK 2020 becomes a Digital Event Experience
The future of CIMON in space – Next stop: Mars?
CIMON will set a new record for an earthly intelligence staying in space. The plan is that he shall work in the ISS for 3 years (the longest human mission is 438 days). It is evident that one of the future potential uses of CIMON may be to accompany long space expeditions – like Mars.
But I can also easily imagine that many of the capabilities developed for ISS could be deployed on Earth for a variety of use-cases ‘at the edge’:
- Autonomous welfare bots in hospitals, elderly care homes, etc.?
- Assistance to maintenance and repairs workers in dangerous, remote or perhaps subsea locations?
- Driver assistant in semi- or fully autonomous vehicles
- Assistant to knowledge workers
- Compliance advisor on the manufacturing floor in regulated industries
- Coach- / trainer / instructor in sports, education etc.
The form factor would, of course, have to be adapted and modified, and many times you may find ‘CIMON’ embedded into other types of devices or perhaps just as the intelligence in applications.
The possibilities are endless – our fantasy is the only limit. if you had a CIMON – what would you use him for?
Fact: CIMON stands for “Crew Interactive MObile companioN). CIMON is developed and tested by DLR (Deutsches Zentrum für Luft- und Raumfahrt / German Aerospace Center ), Airbus, IBM and the scientific partners LMU (Ludwig-Maximilians-University-Munich).
Fun Fact: CIMON’s name is, in part, a reference to ‘Professor Simon Wright’, the robotic assistant – or ‘flying brain’ – in the Japanese science fiction series ‘Captain Future‘ from the 1940s.
If you have any further questions, please do not hesitate to contact me at andersq@dk.ibm.com
![](https://www.ibm.com/blogs/nordic-msp/wp-content/uploads/2021/03/andersquitzau300px-01.jpg)
Research & Innovation Executive, IBM Research - IBM Watson
How to act in the new regulation of financial sector
Our world is changing. Because of that regulators around the world are taking ambitious steps to improve the sustainability of the financial sector and guide capital towards sustainable economic activity. Especially in EU we are seeing a high level of regulations. These regulatory interventions present complex and sensitive legal challenges for financial sector firms, which […]
Private cloud or public cloud? New server technology offers more choice
In September, we launched the new IBM Power E1080 high-end server, for corporate use based on the new Power10 architecture, the Power E1080. The server can – among many other things – handle a large number of applications and workloads securely, at scale and with highest availability. Going into the spring of 2022, we will […]
10 Questions regarding SDG to the company’s management and board
We have all together manged to create the most serious sustainability deficit and our greatest challenge is the ecological debt – a dept which we are running up by overusing and depleting our natural resources and thereby threatening our ability to meet the needs of future generations. Worldwide, the strains on key resources, from fresh […]