Rakuten Mobile uses 4G and 5G networks for successful demonstration of combining real and virtual motorsports racing, 5G

Tokyo, November 9, 2022 –On October 23, 2022, Rakuten Mobile, Inc. (“Rakuten Mobile”) successfully completed a motorsports show that combined reality and virtual at the 2022 Inter Proto Series POWERED BY KeePer Round 2 held by Inter Proto Motor Sports Co. , Ltd. *1. Using 4G and 5G mmWave provided by Rakuten Mobile, an electronic race has been successfully conducted integrating real and virtual by teleportation of driving data, simultaneous augmented reality (AR) display of the virtual car and race car information during the race*2.

This demonstration experiment was conducted simultaneously at two locations: Fuji Speedway, the 2022 Inter Proto Series POWERED BY KeePer Round 2 venue located in Shizuoka Prefecture, and the Rakuten Mobile Ebisu store in central Tokyo. The concept car dubbed “Kuruma” *3 Run on the Fuji Speedway against the virtual car driven by electronic racers using the racing simulator in the Rakuten Mobile Ebisu Store, using data obtained from both sources.

Demo overview:
1. Implementation of electronic racing integrating real and virtual by remote transmission of driving data
2. Real-time simultaneous augmented reality display of virtual cars in racing and augmented reality screen of motor racing information

1. Implementation of electronic racing integrating real and virtual by remote transmission of driving data
By transmitting data of the demo car driven by the actual racing driver running on Fuji Speedway in real time to the racing simulator driven by the electronic racer in the Rakuten Mobile Ebisu Store, the electronic race between the demo car and the virtual car was successfully displayed on the game screen. Telemetry System *4 Provided by M-TEC Co., Ltd. *1 which obtains and transmits data from sources including multiple sensors to measure steering angle and other factors, GPS and cameras installed in the test car running on the circuit enabled a virtual test car equivalent to electronic racing to be displayed on the game screen. 5G mmWave has been used to communicate between the racing simulator and the game server, achieving a realistic real-time racing experience.

2. Real-time simultaneous augmented reality display of virtual cars in racing and View AR from car racing info
At Fuji Speedway, by carrying a smartphone equipped with a dedicated mobile application developed by Rakuten Mobile along the track from the spectator’s seat, or wearing smart glasses and watching the race, spectators were able to watch the race between both the test car that actually ran on the life track Realistic and virtual cars driven by electronic racers competing in the Rakuten Mobile Ebisu Store. Additionally, driving data such as vehicle position, speed, and engine speed generated by both the test car and the virtual car in motion, the racing driver’s perspective video, and the game screen video of the electronic race are also available for viewing on the same app. By utilizing *Immersal Ltd’s*1 VPS (Visual Positioning System) technology, it was also possible to display AR content to viewers in seats around the circle with a higher resolution.

As the 5G network environment continues to evolve, the future is likely to see large-scale motorsports competitions integrating the real and virtual worlds, as well as the multi-angle distribution that allows spectators to check the race status in real time from any seat-side race, providing a much improved viewing experience.

Rakuten Mobile will continue to collaborate with many companies and organizations through the Rakuten Mobile Partner Program, with the aim of providing customers with new experiences that use communication and technology.

*1 Interproto Motorsports, Inc. and M-TEC Co., Ltd. and Immersal Ltd are participating companies in the Rakuten Mobile Partner Program, a co-creation program operated by Rakuten Mobile. For details about each company, please see the following pages.
・ Inter Proto Motor Sports (Japanese only)
URL: https://drivingathlete.com/
・ M-TEC (Japanese only)
URL: http://www.mugen-power.com/
・ Immersive
URL:https://immersal.com/
*2 At the 2022 Inter Proto Series POWERED BY KeePer held on Sunday 23rd October we had a demo in Round 4 of the Gentleman Race (race start at 9:15), Round 3 and 4 of the Pro Race (race start at 15:00) and 15:30).
*3 “kuruma” is a Japanese racing car that was built from the ground up for the “Interproto Series”, a one-man-made race (a race in which all types of racing cars are standardized).
*4 Telemetry is a system that collects driving data (driving position, driving speed, engine speed, etc.) of a driving vehicle and transmits it to a remote location. Telemetry function.

Leave a Comment