The latest generation of electric toothbrushes supports users with applications on their smartphones. Based on the image analysis software Shore, developed by Fraunhofer Institute for Integrated Circuits IIS as well as its localisation technologies for position recognition, Procter & Gamble is now presenting a new smart toothbrushing system at the Mobile World Congress. By telling users which area of teeth they are currently brushing, this system supports them in their daily dental hygiene as recommended by dentists.
It’s not just the toothbrush that determines whether dental care is correct and improves dental health. To keep teeth healthy, it’s much more important to brush correctly and pay equal attention to all areas. To support users as effectively as possible, Procter & Gamble (P&G) has been working with scientists from Fraunhofer IIS on the development of a new smart interactive toothbrush Oral-B Genuis. The toothbrush connects via Bluetooth with an app on users’ smartphone, which can be affixed directly to a mirror. Analysis can begin as soon as users begin brushing their teeth.
The integrated Fraunhofer Shore facial detection and analysis technology allows head movement and hand position to be recognised and analysed in real time. This lets users know whether they are brushing too little or too long in one place, or whether they have missed an area. “We are using image based classification to further develop and refine the algorithm of our Shore software library so that it can determine the exact position of the toothbrush,” is how Dr.Jens Garbas, head of the Group for Intelligent Systems explains the technical challenge facing his team. “Shore has to be able to provide reliable results even with poor lighting, frequently changing head positions or rapid hand movements.” The Fraunhofer developers use their Shore software to determine the position of the jaw from images and evaluate the results with a large number of testing sequences.
In order to further improve the robustness and precision in line with requirements, the Shore developers have taken colleagues from the Multi-sensor Systems Group at Fraunhofer IIS on board. Thanks to what are known as inertial sensors in the brush handle, smart analysis software can assess the brush’s position and movements and combine this information with data from the image analysis. The advantage of this type of sensor fusion is that more precise information is generated on whether each area has been brushed for a sufficient period of time and whether any areas have been left out. Users can see the results directly on their smartphones and adjust their brushing accordingly. “Our challenge in achieving sensor fusion across the two technologies was to produce a reliable classification of the brushing area even when the acceleration sensors weren’t delivering measurement data with a high data rate. Our determination to solve this tricky task without building any additional technology into the system was what spurred us to come up with new approaches to sensor fusion for optimum combination with image processing data,” reports group leader Jochen Seitz.
P&G, a world leading manufacturer of household, health and beauty care products, whose portfolio of brands includes Oral-B and Braun, has been collaborating with scientists at Fraunhofer IIS since 2013. In its search for a highly reputed, reliable development partner for a new, smart generation of toothbrushes, the P&G Group’s Research Division noticed a presentation of Shore facial detection and analysis software. The efficiency and capabilities of Shore soon brought the two partners together to develop new ideas and solutions for software based assistance systems. “The scientists at Fraunhofer IIS have excellent technological and application-oriented know how. Our collaboration with them supports us in the user oriented further development of attractive new products, so we can offer our customers real added benefits for dental hygiene,” says Frank Kreßmann, from research and development for connected devices and oral hygiene at P&G.
The new Oral-B Genius smart electric toothbrush, featuring integrated image analysis software and movement analysis developed by Fraunhofer IIS, offers users far more advantages than many familiar applications of electric toothbrushes to date. Procter & Gamble is presenting these new interactive toothbrushes at the Mobile World Congress in Barcelona.