Will HMD-Headsets for any HDMI source, in 2D-Mode SideBySide, appear?

RAZOR OSVR – its opensource…
so there could be many contributors that make things possible.
But most of them, i guess, are hunting the VR virtual reality stuff.

The way to consumer VR is still long. And till VR gets reality in consumer homes,
we could have fun with HMD Headsets in 2D, with headtracking.

I would like to see the possibility to plugin any HDMI source/signal,
and convert it to SBS SideBySide by the Headset itself, or by extra box.
Then many gamers could use this for their flight/racing games in 2D-only mode,
and console gamers like PS4gamers too(WarThunder, ProjectCars).
Headtracking could be made with HMD´s own sensors or
extra independent external sensors that act like a usb mouse (in case of PS4).

Razor OSVR – HMD is available? REGISTER YOUR INTEREST ?

http://www.razerzone.com/osvr
http://www.razerzone.com/osvr-hacker-dev-kit

http://www.osvr.com/hardware/register/
the packages start from 200 US Dollar… up to 300 US Dollar,
the package prices are lower than the sum of the components alone

but till now, you can only
REGISTER YOUR INTEREST
and not BUY

PS4 + HeadMountDisplay … working in SideBySide – working setup

He got it,

Head mount display, Phone, playing PS4.

Veröffentlicht am 06.06.2015
https://www.youtube.com/watch?v=S9OGj-vX_xg
Sony Z2 Phone (FullHD)
+ CM11 (CyanogenMod)
+ SBS 1.09 (Native SideBySide)
+ Remote play
+ DS4 controller

nothing about head tracking..
but i would use my ZEISS/Arduino Headtracker..
and would try USB OTG Ethernet.. instead of Wifi…

VR – Hype

VR – Virtual Reality

Category 1:
– Headmounted Display
– cinema like, big screen, 2D/3D
– no sensors
– viewer in sitting postion
Examples: google cardboard, zeiss cinemizer,..

Category 2:
– Headmounted Display
– cinema like, big screen, 2D/3D,
– view is controled by head movements of the viewer
– Sensors: head tracking
– viewer in sitting postion
Examples: google cardboard, zeiss cinemizer + headtracker sensor,..

Category 3:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking
– viewer in sitting postion
Examples: oculus rift, starvr, sony morpheus, …

 

Category 4:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking, leap-motion controller
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, without exact finger movements
– viewer in sitting postion
Examples: devices from category 3 with additonal sensor

Category 5:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking, leap-motion controller
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, with exact finger movements
– viewer in sitting postion
Examples: devices from category 3 with additonal sensor

Category 6:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking, leap-motion controller, body scanner
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, with exact finger movements
– viewer can move around (more or less free in terms of cabled solution or not, or wearing more or less heavy graphics computer in backpack)
Examples:

Category 7:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head and eye  movements of the viewer
– Sensors: head tracking, leap-motion controller, body scanner, eye scanner,
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, with exact finger movements
– viewer can move around (more or less free in terms of cabled solution or not, or wearing more or less heavy graphics computer in backpack)
Examples

 

problems:

– sensoring every movement of person, eye, head, body, arms, legs, fingers,…
– computation of sensor inputs into virtual world
– graphical computation in 3D, starting from easy cartoon, cell-shading till realistic styles
– stream lagless video to displays (60GHz, http://www.wirelesshd.org/) or wear the graphical computer units with yourself
– full natural field of view
– eye tracking
– 3D audio support, 360degree x 360degree
– no simulated acceleration on human body,
– no pressure points on human body,
– no simulated smell

consumer products will be at middle level, while expensive equipment will be used in new public gaming studios, where you can play for a fee ( thevoid.com )

CMOAR is closing the gap

cmoar
http://cmoar.com/index.html
is going into „preorder“ phase.
http://pre-order.cmoar.com/

they close the gap, which gap?
They offer “ 5.98” 60Hz Full HD add-on screen for streaming via HDMI (1920×1080 – 368ppi)“ [, also a 2k version!]
https://www.youtube.com/watch?v=3UqV1hdA9W8
This display can be used  instead of a phone!
This display is full hd.
This display is cabled hdmi – no lags caused by wifi stuff.
in combination with
the cmoar headset with 2D mono lense
http://pre-order.cmoar.com/collections/hmd/products/cmoar-2d-high-quality-headset
we can use PS4 hdmi output connected to this head mounted device.
Thats what i am  looking for.
What is best/most effective/good price/high performing
option playing games today in HMD, my opinion.

But what about sensors?
I have my own ZEISS headtracker USBversion.
That will give me freedom of head tracking.

With this combination
we can play flight-/car-simlulator (war-thunder, project-cars),
without 3D (i dont need it, not yet ;o) ),
without lags,
in high video quality,
with head tracking,
enough immersion for first head mounted experiences.

cmoar is aiming to deliver in fall 2015.
i hope they will do so, but projects are mostly not in time… ;o)
Will sony delivere their Morpheus realy in first half of 2016?
, and at which expense?!!

When cmoar delivers this 2D stuff, and it works..
then i could look, for their 3D/VR stuff.. but thats another story,
demands other hardware and games too,
2D HMD is now, 3D HMD is next

 

PS4 Morpheus comes with external break-out box

SONY PS4 seems to render all, inclusive warp for lense adaption, on the console.
A needed external box will connect between PS4 and headset, and calculates an additional video stream from the warped data for a external TV screen („social screen“)

„… takes one of the stereoscopic views, ‚undistorts‘ the image, zooms into the main area of interest and beams it out via HDMI to your HDTV..“ from http://www.eurogamer.net/articles/digitalfoundry-2014-hands-on-with-project-morpheus

http://www.vrworld.com/2015/03/06/project-morpheus-vr-headset-wont-be-wireless/
http://www.eurogamer.net/articles/digitalfoundry-2014-hands-on-with-project-morpheus

input:  HDMI ,USB(3.0?), power
output: HDMI for TV screen „social screen“
but there are 5 plugged in cables… there is an additonal USB Port

WHY DONT DO THIS THE OTHER WAY.
like the already described hypothetic TrinusVR Stream-Converter-VR-Box.
PS4 could render videostream in standard 3D format without warping, send this standard videostream to an external extra box, where a second screen can be added and the data is warped for lenses for headset.

Dreaming of TrinusVR StreamBox

PS4 HDMI out
PC HDMI out

2D/3D content, FullHD

connect to a MagicBox
that acts like TrinusVR ( http://trinusvr.com/ )..
you can adjust everything to use any headmount display.
The MagicBox captures the input stream and makes halfSBS (or others)
To make all adjustment and settings, you can plugin USB mouse/keyboard and an monitor via HDMI to have screen where you control the settings for output.

The output goes over
– Wifi 2,4/5/60GHz,
– USB using smartphones tethering capabilities
– HDMI

if someone would need to add two displays, to use one for left eye and one for right eye.. then we would need usb and hdmi outputs twice, and some settings more
( 2x samsung S6 with stunning resolution ppi ;o) )

So we could use any smarthphone as head mounted display, with 2D or 3D content.
So far without headtracking.
You need headtracking?  Playing Car or Flight simulators?
No problem, you could use external sensors like ZEISS Cinemizer USB headtracker or even sensors from smartphone itself, if industrie/programmer would support.
Imagine your smartphone send sensor data via wifi to and USB stick which emulates Mouse input… but maybe your smartphone sensors are ugly.. drifting.. so you would need a sensor like ZEISS Cinemizer USB headtracker, maybe even smaller and without cable.

Back to the box.. who could build such a box ?
Maybe proffessionals like team from
https://www.blackmagicdesign.com/de
https://www.blackmagicdesign.com/de/products
https://www.blackmagicdesign.com/de/products/intensity
they have the technology of streaming and capturing, but they would have to add new VR virtual technology like TrinusVR already represents.

 

in case of cabled output using HDMI…
there is a problem today,
were are 5″-7″ fullHD displays with HDMI input?
i have not found them yet..

Wishlist to Sony PS4: USB thethering + SBS 2D/3D

Till now PS4 + Remote Play
gives best performance, graphics in fullHD,
on an 8″ Z3 sony tablet, with a small lag.
All till now tested PC streaming programs were not as good as sony remote play streaming.

To avoid this small/tiny lag,
we would have to use cabled version.
But how to tell the PS4 to give video out on USB port (there is USB 3.0 Port too)
so that we could use smartphones USB Thethering.
A point for wishlist, adressed to sony playstation network.

Next thing would be to enable SBS for 2D and 3D for video out.

Games like „Lost Orbit“
http://www.ign.com/games/lost-orbit/ps4-20027497
would be cool in small smarthphone headmount.

But i guess..
sony will offer you Morpheus HMD for BIG money,
only few can realy pay.

But hey sony,
for rare playing casual users,
playing  games in 3D without headtracking would be great even without total immersion!

 

 

PC: Trinus VR + War Thunder(PC) + S4mini/Z3tablet

in Android PlayStore i found „TrinusVR“ and so i tested it on my old weak computer.

With TrinusVR you can send Videostream from PC, from a PC window, converted as SBS SideBySide to a Smartphone, with 3D or at least without 3D (Fake3D = 2D).

The App is available as Demo Version „Trinus VR Lite“, was installed easily.

I picked up my old computer, a core2duo 2GHz, and installed
War Thunder. War Thunder looks great even on weak maschines. Till now i only knew the PS4 graphics. And second: PC mouse aiming is not fair. Gaijin should add some option for gamers so that they could decide, if they want play with or without opponents which are using mouse steering.

So ok… start the TrinusVR PC Server. Used first the Wifi setup, USB later. So i took my Z3 tablet and logged in Wifi access point started by TrinusVR „trinus:mypassword“. and then started Android App of TrinusVR. This works, but graphic was ugly.. because PC initial details setup was set „retro“ which means 256 color and block style graphic. While streaming is working we can adjust some settings at PC server software.. Graphic details too, after that it was quite good. But at all my PC was 100% cpu load all time. The main game was running smooth but the stream was not at all. So i guess its a PC CPU bottleneck.

So i went to USB connection. Using USB Tethering on Android. My Z3 tablet is a Wifi only version and it gives me no option for selecting Tethering! So i took my Samsung S4 mini Dual Phone and it has the option Tethering over USB. This works, but better? Maybe the CPU of Phone should be better? And the S4 mini has only qHD, one fourth of HD! while the Z3tablet gives me FullHD.

At the end i went back, using Z3 tablet with Wifi. Using a google cardboard asked me to dig deeper in the settings, because cardboard with its lenses is designed for 4″ Phones and not for 8″ as the Z3tablet is.
But TrinusVR gives us the possibility to adjust everything. Switch to „Advanced Mode“, and „VR settings“ we can arange the SBS view, positioning, sizing, turning.. so i got the cardboard useable at 8″ tablet… not handy but viewable.

but realy playable, it was not.
A better PC-jhardware would be required i guess so far.

Going further… trying Durovis Dive 7 with z3tablet 8″.
or using a better FullHD Smartphone 4-5,7″..
Samsung Edge 12,92 cm Quad-HD-Super-AMOLED-Display (2.560 x 1.440 Pixel)
;o)

PS4 + Remote Play + Android Naitve SBS

With the App „Android Native SBS“ you can use any app in a SBS Mode.
Check/Mark the apps from yopur installed app list, so that these will start in SBS style, when they get started.

Fine, cool, BUT.. you have to root your android smartphone.

and so i stopped here.. this would be the best way coming from phone side..
because i guess SONY will not add SBS Support for its PS4-Games, PS4-Side or RemotePlayApp-Side, because they want you to buy Morpheus Real 3D,
but hey, 2D is even cool too, please SONY make us a gift or extra app which we have to pay for to get SBS support in RemotePlay-App.

https://github.com/frma71/sbs