2D HMD simplified using moonlight

Laptop MSI GS30 + external MSI GTX980-4G
nvidia GTX graphic cards support streaming capabilities
>> http://moonlight-stream.com/ <<

Smartphone Sony Z2
+ USB OTG + USB-RJ45 Network adapter -> Router, where PC is connected to also
+ Moonlight App for Android
+ Lenses, Reading glass, +5.00 dioptrien

Durovis DIVE 7 modified

ZEISS Headtracker USB connected to PC and added to HMD

Moonlight App Settings:
– resolution 1920×1080 with framerate 60
– bandwith begin with low values.. when using higher values the stream will begin to stutter badly..
– sound from PC .. i use PC connected sound/earphones
– no controlls .. i use PC connected devices mouse/keyboard/HOTAS

start PC Geforce Experience Center (games are already set, which should/can be used for streaming)
shut down Windows Firewall for Private Network
start Smartphone App Moonlight
Manualy set IP of PC we connect to … look for it with PC cmd ipconfig . something like 192.168.0.101
successfully connected ? ok… then choose the PC in the App. will display the in Geforce experience center preconfigured games.. choose one ..like WarThunder, War Thunder starts with launcher as normal, you can choose graphic resolution and VSync (btw: will have refreshrate of your configured display settings, for me the display port full HD at 144Hz)

game will start and run at 60Hz on Smartphone nicely !! without artefacts! supersharp crisp..

using  the Smartphone for HMD is better , because to look at corners HUD elements you will not have to move your eyes at extreme positions like it would be with bigger tablet…

what we realy need is a mobile „VR“ Smartphone  HMD .. that has no lenses.. and adjustable distance for smartphone..
so we can use own reading glasses like  normal glass… not adjusting inside lenses

and a further feature wood be.. to buy a used Z2 Smartphone and open it completely to take out the display.. to add a longer ribbon cable between display and smartphone… to put only the thin display in front and the weighty rest of the smartphone put at hmd close to head..

2D FullHD HMD – magnifying lens

using a magnifying lens, type fresnel, like this one:
http://www.rakuten.de/produkt/moses-verlag-gmbh-librix-folienlupe-945796086.html?_ga=1.29934527.1041642812.1451245370
costs only 5,- euro.

we can use a tablet like Sony Z3 tablet compact or smartphone like Sony Z2
(with native Playstation Remote Play + Fligh Simulation (WarTHunder) + Headtracker),
bring the display very close to our face while using the magnifying lens to avoid crossing eyes,
having 2D full HD working, in none Side-By-Side.

so we can try to build something from scratch or modify a durovis dive 5 or durovis dive 7.
so we can have today, what cmoar wants to bring out anytime in a commercial version, the 2D mono lense.

this will be a good base for PC based game streaming too.

FullHD to Side-by-Side problems

when you want to take a FullHD video stream
into Side-by-Side mode for your HeadMountDevice Full-HD mobile device screen,
you will trap into following problems:

1.
keeping landscape mode, alias fit to width, for each eye,
with this mode you will loose in height, image looses its sharpness because of downsampling

2.
fit to height, keeps sharpness, crispy video,
but loosing information in width..
eg any game infos at the original screen corners will disapear,…
we would need to cut out these information and overlay it at the new
video dimensions 960/1080 per eye.. into new corner coordinates..

SONY Z2 + Android native SBS + PS4 Remote – finaly DONE

this will give you a 2D HeadMountDisplay, not 3D!

SONY Z2 smartphone rooted with Cyanogenmod CM11

sdcard needed, is mounted as /storage/sdcard1/
https://wiki.cyanogenmod.org/w/Sirius_Info
http://download.cyanogenmod.org/?type=snapshot&device=sirius
cm-11-20141112-SNAPSHOT-M12-sirius.zip
https://wiki.cyanogenmod.org/w/Install_CM_for_sirius

Attention:
getting your bootloader unlock code from SONY
http://developer.sonymobile.com/unlockbootloader/
you need a email adress with a .com adress!
with gmx.de, gmx.net, web.de adresses you will get no answer, no key from sony service

i used the way using a sdcard,
copy the zip on sdcard and so on…

the drivers you will need:
http://doomlord.xperia-files.com/download.php?dlid=Rmxhc2h0b29sLWRyaXZlcnMtMS41LTIwMTQwMzE4
Flashtool-drivers-1.5-20140318.exe
after installing the drivers fastboot will respond correctly
fastboot getvar version
version: 0.5
finished. total time: -0.000s
so then you can unlock bootloader

to have Googles Store we need GoogleApp Set
https://wiki.cyanogenmod.org/w/Google_Apps
we have with CM11 the android version 4.4.4
it the Z2 processor a 64bit version?
http://www.gsmarena.com/sony_xperia_z2-6144.php
Chipset Qualcomm MSM8974AB Snapdragon 801
CPU Quad-core 2.3 GHz Krait 400
http://www.notebookcheck.com/Qualcomm-Snapdragon-801-MSM8974AB-SoC.103629.0.html
64 Bit 64 Bit wird NICHT unterstützt
-> ARM.. kein ARM64, kein x86

i took the stock Google_Apps version..

the rest is described yet in the manuals..

then added App Android native SBS.. cost some bugs…
giving root to this app if asked for
ImageDistance 0 and Zoom 100% will work.
my hint: use a bluetooth keyboard with additional touchpad to navigate in SBS mode.. will be very helpfull.

Then PS4 RemotePlay app
latest version 1.3.2

allow apps from unknown sources
http://www.mediafire.com/download/s2l9dl5el2d42lr/RemotePlayPortITBV1.3.2.apk 5.88MB
RemotePlayPortITBV1.3.2.apk
copy to sd card.. from pc over usb cable to the phone sd card
filemanager, install apk file..

i have a bluetooth keyboard+touchpad for SONZ Z2 SBS-Mode,
PS4 has keyboard, mouse, DS4 controller,..
i did not used the App Sixaxis

CM11 was not working over ethernet, so i tested App Ethernet.. but PS4 remote play only worked with Wifi..

RemotePlay App Settings Quality and RefreshRate from Standard set to High.
PS4 connected with ethernet to router. Router has wifi net, which the SONY Z2 is connected to.

Using a Homido headset.
Nice result.. but WarThunder is playable, but not against other players.. its good, but not good enough.. WHY?

SONY Z2 has a FullHD display..
and we use SideBySide SBS.
So two screens are displayed in a single FullHD display.
This results in a QUARTER HD final resolution!!!
Playing WarThunder we will need finaly FullHD (per eye when SBS method is used), this means 4x FullHD resolution, so that each eye gets its own FullHD view.

!!!
– WE NEED 4K Smartphone Display or
– or The Games must render crisp screens in Quarter-HD that result in crisp view
– or CMOAR Headset 2D mono lense will give us BEST Result in FullHD
!!!

All the VR sets coming soon
http://www.vrnerds.de/hardvr/96-2/vr-brillen-vergleich/
are FullHD for both eyes..

I give my attention to CMOAR Headset 2D mono lense.
http://cmoar.com/lp_2d.html

then we can go again with SONY Z2 and PS4 RemotePlay, without SBS, in finaly FullHD.

CMOAR – news feed only on Kickstarter

who wants to be up to date with cmoar development, has to look for their kickstarter page.
Only bakers can leave comments, so we from germany, can only read…
kickstarter.com/projects/706938033/cmoar-virtual-reality-headset-with-integrated-elec
kickstarter.com/projects/706938033/cmoar-virtual-reality-headset-with-integrated-elec/comments

summaries by developer team:
kickstarter.com/projects/706938033/cmoar-virtual-reality-headset-with-integrated-elec/updates

actualy (2015-08) they are solving issues with consoles compatibility.

i hope, they would deliver in 2015.
i only want/need the HMD 2D Version without sensors for PS4-hdmi, i will use my ZEISS headtracker(IMU),
so,…

on reddit some cmoar headset stuff
https://www.reddit.com/r/GoogleCardboard/comments/2w4gtn/cmoar_mobile_virtual_reality_headset_with/

PS4 Morpheus – News from vrnders.de Gamescon2015

http://www.vrnerds.de/gamescom-2015-project-morpheus/

Tragekomfort:
gut-sehr gut, bei schnellen Bewegungen etwas wackelig,
nun es ist ja kein Helm, und die Auflageflächen zum Kopf hin sind begrenzt,
und die Gesichts/Kopfhaut liegt flexibel auf dem Schädel,
wenn man es „übertreibt“, wird man es immer zum Wackeln bringen können.
Die Erfinder des Zubehörs wirds freuen, uns mit Lösungen hierfür überraschen zu dürfen.

high stable frame rate
Vermutung: erkauft durch Abschaltung Kantenglättung, sichtbare Treppchen-Effekte

kein Screendoor-Effekt:
Vermutung: erkauft durch etwas Unschärfe

Schade das Sony auf eine extra externe Recheneinheit/Box verzichtet,
dann hätte man Kantenglättung und andere Nicht-Rendering,
Standard-Rechenoperationen auslagern können.

Will HMD-Headsets for any HDMI source, in 2D-Mode SideBySide, appear?

RAZOR OSVR – its opensource…
so there could be many contributors that make things possible.
But most of them, i guess, are hunting the VR virtual reality stuff.

The way to consumer VR is still long. And till VR gets reality in consumer homes,
we could have fun with HMD Headsets in 2D, with headtracking.

I would like to see the possibility to plugin any HDMI source/signal,
and convert it to SBS SideBySide by the Headset itself, or by extra box.
Then many gamers could use this for their flight/racing games in 2D-only mode,
and console gamers like PS4gamers too(WarThunder, ProjectCars).
Headtracking could be made with HMD´s own sensors or
extra independent external sensors that act like a usb mouse (in case of PS4).

Razor OSVR – HMD is available? REGISTER YOUR INTEREST ?

http://www.razerzone.com/osvr
http://www.razerzone.com/osvr-hacker-dev-kit

http://www.osvr.com/hardware/register/
the packages start from 200 US Dollar… up to 300 US Dollar,
the package prices are lower than the sum of the components alone

but till now, you can only
REGISTER YOUR INTEREST
and not BUY

PS4 + HeadMountDisplay … working in SideBySide – working setup

He got it,

Head mount display, Phone, playing PS4.

Veröffentlicht am 06.06.2015

Sony Z2 Phone (FullHD)
+ CM11 (CyanogenMod)
+ SBS 1.09 (Native SideBySide)
+ Remote play
+ DS4 controller

nothing about head tracking..
but i would use my ZEISS/Arduino Headtracker..
and would try USB OTG Ethernet.. instead of Wifi…

VR – Hype

VR – Virtual Reality

Category 1:
– Headmounted Display
– cinema like, big screen, 2D/3D
– no sensors
– viewer in sitting postion
Examples: google cardboard, zeiss cinemizer,..

Category 2:
– Headmounted Display
– cinema like, big screen, 2D/3D,
– view is controled by head movements of the viewer
– Sensors: head tracking
– viewer in sitting postion
Examples: google cardboard, zeiss cinemizer + headtracker sensor,..

Category 3:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking
– viewer in sitting postion
Examples: oculus rift, starvr, sony morpheus, …

 

Category 4:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking, leap-motion controller
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, without exact finger movements
– viewer in sitting postion
Examples: devices from category 3 with additonal sensor

Category 5:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking, leap-motion controller
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, with exact finger movements
– viewer in sitting postion
Examples: devices from category 3 with additonal sensor

Category 6:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head movements of the viewer
– Sensors: head tracking, leap-motion controller, body scanner
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, with exact finger movements
– viewer can move around (more or less free in terms of cabled solution or not, or wearing more or less heavy graphics computer in backpack)
Examples:

Category 7:
– Headmounted Display
– wide field of view, 3D
– view is controlled by head and eye  movements of the viewer
– Sensors: head tracking, leap-motion controller, body scanner, eye scanner,
– additional hand/arm tracking, you can move your hands and see them 1:1 in virtual world, with exact finger movements
– viewer can move around (more or less free in terms of cabled solution or not, or wearing more or less heavy graphics computer in backpack)
Examples

 

problems:

– sensoring every movement of person, eye, head, body, arms, legs, fingers,…
– computation of sensor inputs into virtual world
– graphical computation in 3D, starting from easy cartoon, cell-shading till realistic styles
– stream lagless video to displays (60GHz, http://www.wirelesshd.org/) or wear the graphical computer units with yourself
– full natural field of view
– eye tracking
– 3D audio support, 360degree x 360degree
– no simulated acceleration on human body,
– no pressure points on human body,
– no simulated smell

consumer products will be at middle level, while expensive equipment will be used in new public gaming studios, where you can play for a fee ( thevoid.com )