It wouldn't take much genius to apply the same tech to a stereo audio only experience, with motion tracking of the virtual binaural piano model that Pianoteq already has. There are people out there who do know a lot about VR and head tracking and the cameras and technology for VR. Maybe we can use or adapt the existing hardware somehow? Perhaps the host computer could use a 3D camera like that and track motion if people stuck a few high-vis stickers onto their headphones(!) or perhaps you could just use your PSVR or Oculus headset while you play Pianoteq, and to that end, it would be great to have a 3D rendered Steinway D image in front of you too! although millions of people (including pianists like me) already do own VR headsets like PSVR and the 3D stereo Playstation cameras which connect via USB. This idea is not easy to implement and test, because obviously the required hardware is not commonplace.īeyerdynamic Headzone Pro was on manufacturer's attempt at head-tracking headphones, but I can't think of many others. Our ears therefore perceive an ever changing stereoscopic sound perspective, which even with binaural HRTF recordings is not captured by one stationary fixed mic position. we're hardly ever sitting still, static and locked in one place. Pianists play with huge expression and body language, rolling their torso and shoulders around, wild head movements, etc. I now think, lack of head motion tracking, is probably the stumbling block why playing digital pianos always feels fake, whereas real acoustic pianos actually exist in front of you. I think the same user experience quantum leap up going from "fixed" stereoscopic 3D photos and video, to totally immersive motion-tracked 3D stereoscopic virtual reality, could be an equally impressive quantum leap forward in the "sonic virtual reality" and our holy grail quest of trying to reproduce the feeling and sonic experience of sitting in front of a Steinway D concert grand piano. You could even stand up from your stool and lean forward putting you head inside the lid, over the strings and hammers, like you can with a real grand piano (lid open) and hear their vivid brightness, feel their proximity. As you lean in closer, things get louder, as you bend to the right or left, you hear the treble or bass keys more closely. Then, I believe, the grand piano would "appear" before you as an almost tangible 3D sound source. Now, suppose there was a way of combining live head-tracking for your stereo headphones as you play Pianoteq in binaural mode, whereby the movements of your own head could be mapped and applied in real time to reposition the virtual "headphones" of Pianoteq's binaural sound recording 3D modelling of the acoustic environment. Without that sensory feedback loop you still remain disconnected from the truly convincing immersive experience. Now, those of you who've ever tried a Sony PlayStation PSVR or Oculus Rift virtual reality headset, will know that you experience a much more convincing illusion of tangible 3D "reality" from the live head motion-tracking virtual reality experience, than you ever feel before from simply looking at flat "fixed" 3D stereoscopic photographs, or holograms, or even a "moving but still fixed" 3D stereoscopic video (like watching 3D Blu Ray) although it's motion video with a changing viewpoint perspective, your own natural human head movements (the way you instinctively interact with the world around you) have no effect on the "fixed" perspective the director is showing you in the 3D movie. More importantly, the same 3D freedom is allowed for the virtual "headphones" in binaural model. The Sound Recording mode allows almost infinite variable positioning of the virtual mics, any position in virtual 3D space (X,Y,Z coordinates and aiming any orientation angle.) Many years ago, it was me, propianist, who suggested to Niclas Fogwall about making the parameter edits note by note using a "graphic equalizer" with 88 sliders, rather than single global control, and this idea was successfully adopted into Pianoteq Pro. I've just had a brilliant idea - Modartt developers, I hope you are reading this.!!!!!!!!
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |