Pixel 4XL Infrared sensor via getUserMedia

It’s turns out that you can access the pixel 4 face detection IR camera via normal getUserMedia. The interesting thing is that if you try to do face unlock when this camera is being used (the bit where it throws things on to your face) the system will just flat refuse to do any of the face unlock process and that makes sense.

If you want to quickly try this then you can view the demo here.

Anyone got any ideas about what we can do with infrared camera access?

Update

Francois Beafort updated Blink by adding infrared to the camera name if the device supports it - this will let you quickly get a better understanding of the type of camera just by the name (also will let users pick the one they want more effectively).

Paul Kinlan

Trying to make the web and developers better.

RSS Github Medium

Likes

Weston Ruter Lukas Caha V Strange Mojo Johannes Wachter WTM Eldoret Jeffrey Yoo Warren Caleb Carithers Bwana Maina DevFest Rift Valley Maximiliano Firtman @ Bay area 🇺🇸 MRr Wiktor Olejniczak Niklas Blum Mark Tomlin Simon Ström Muhamad Firhat Francesco Vaccaro pwafire.org Jeremy Bae GDG Eldoret Alikulov Derek Gates Morris Chen Spencer Wannop Michał Siwek razh Matt Ludwig JimmyHo LA_1100 Olivier Leplus 👨‍💻 🌲 Oyster Laboratory Wilson Tovar Gonzalo Toledano Kevin Ouyang Javascript Hockey InSuperposition Nasi Atanasov Anderson Eduardo Jake Dohm klaudiusz zycinski Didier FRANC Ted Erik Alsmyr Tina Umlandt Matthew McCune Ahmad Nassri Kris Henderson จัสติน Munawwar Firoz Tsahi Levent-Levi Abdu Manaz Casey Primozic Lox Luis E. Fraguada Lucid00 Skanda D Meda Braunson Yager Natalie Silvanovich ✨ Joël jason Thibault Molleman Shantanu Raj Joshua Pritt Vishal Das (he/him) Martin Kleppe Judah ‘austere religious scholar’ Gabriel Mike Giambalvo sublimer Ashir Ashraf Praveen Puvvula Fatxp Jared A Sutton 🌹 PJ McLachlan 🌄 Patrick Hiller Anssi Kostiainen rufatZZ Majid Hajian Aryendra Singh Jose Antonio Bravo sidasa zzz amolt ⚡ dominic go 🏳️‍🌈 🇵🇭 Omar Tosca Chakri John Florin Gorgan 🇵🇭 Legomite Gabriel Muñoz Hectør🅪 Ø∆ mykyta Maximo Cozetti Gareth Morgan análise sensorial de mortadela Not Mac Wolfram ⪡JS-- HTML++ CSS++⪢ Kriesing Anton Shevchuk 🇺🇦 gabfiocchi 👨🏼‍💻 Krzysztof Hankiewicz 🏳️‍🌈 ☕️ 🎮 📺 🦄 💻 Shane Reustle asp95 Risyandi Ricardo Machado Anton Juul-Naber Johannes Camin Dan Brickley Laura-Louise Christina Siddhesh Kothadi \助けよや/ xavierbourry Masataka Yakura blAck PR ゆき Jose De Las Salas teška hughes 🐸 Rahul Raj ✨ Lavanya Komarasamy Frank Lindecke Aleksei Safin Richard Hyndman Kai Forsman Nitya Narasimhan Koji Sugimoto Rupesh Prabhu akash kannan Yoav Weiss Stefano Guglielmi Vikash Agrawal 🌈 Franco Andrés Dave Smart 🤫 #SilentRevotution 🤫 Santosh Yadav Juan Miguel Alcala avellar Antonio Rodriguez Andres Bachini Ingvar Stepanyan Ethan Muller Husam Ibrahim Jonatan Jaskilioff Tighterscript 💙 Mzumaray Josue G. Ravi Poooooooooòooooooooooooooooooooooooooooonnnnn .skratch.dot. gooGof Sarawut fakenickels Graydon Pleasants Stefan Đokić ᴍɪᴄʜɪ. Luca Casonato 🇪🇺 🌻 Gokul Sha Alibhai George Salib® Maye Edwin じーやん 🍊 ✨ Javier Corra Harada Yayane "Moses" Kiyohide Saurabh Rajpal #WeAreWebinion Jason Miller 🦊 ⚛ Alex Delzar adrian Abinash Mohapatra {...alexReddicks} Jossi Wolf Juan Gerardo Ruelas Jr. Peter Fernandes Marco Antônio Linus Erdi Shivam Singh Anderson Freitas Eduardo.𝚟𝚞𝚎 Arnelle Balane Luigi De Rosa Petr Mitev Rodrigo Mello 峰 Jartreg Sivasubramanyam A Kélian CLERC 🅜🅐🅝🅘🅢🅗 Ukaton Gabriel de Oliveira Barbosa Giga Byte Satish dackdel Mike Todd Kristof Neirynck Tim Panton Janne Aukia god samn it Jes Conradsen ᒍᗩKOᗷ E Maxime Roland Smeenk #HoloLens Anthony Maki Ed Wios Matt DesLauriers Sean M. Tracey Prashantha Rahul Rana Daniel Brown Eddie Frufus Gilberto Cocchi Martin Schierle Martin Splitt @ 🇨🇭 🏡 David Rousset DrummerVsDrums Mr.doob Roman Nurik Marius Obert stonecobra Surma Mathias Bynens Vitalii Bobrov Awais Stefan Fejes Jabran Rafique ⚡️ Lars Knudsen in 🇩🇰 Oliver Charl Best 🇿🇦 🇮🇪 Alex Russell Rijubrata Bhaumik KΞNNΞTH C. ⚡ Shunya Shishido Eric Lawrence 🎻 andreban Rainer Zufall Cem 💎 Harvey Mar Canet Solà lil PWA nachi Rowan Merewood bruno boutteau Cully Larson Vikram is hiring! 👩‍💻 👨‍💻 👾 Andre 🦄 Minko Gechev Jeffrey Yasskin rektide de la fay Arthur Stolyar Mishaal Rahman I'm Jimmy 🌕 Luis Montes ⚡ 🚲 𝚃𝚑𝚎 𝙱𝚒𝚝𝚌𝚘𝚒𝚗 𝚂𝚚𝚞𝚒𝚛𝚛𝚎𝚕 Johan Westling 🇦🇽 Luke Moll 🙃 Henry Lim

Reposts

shino DevFest Rift Valley MRr Michael Herman Luis Rita GDG Eldoret Derek Gates Sergey video et taceo Christopher Louis Chancé sublimer Philipp Hancke dominic go 🏳️‍🌈🇵🇭 Anton Shevchuk 🇺🇦 Krzysztof Hankiewicz 🏳️‍🌈 ☕️ 🎮 📺🦄💻 Siddhesh Kothadi Ricardo Machado Praveen Pal ⚡ #WebForYou #CloudCommunityDay 𝔎𝔢𝔳𝔦𝔫 kornel@mastodon.social Malte Ubl Illia Seheda Frank Lindecke José M Casani Guerra blank Ingvar Stepanyan Kazuyuki Honda Santosh Yadav Antonio Rodriguez Wes Bos Surma Saurabh Rajpal #WeAreWebinion Eiji Kitamura / えーじ adrian Maye Edwin Tyler Reiff Comandeer Bryn Shanahan Filipe Batista Giga Byte /// Daniel Brown Anthony Maki Yvan Guidoin Matt DesLauriers Mr Musale jameschurchman Aiman Razak // Weather Reporter To-Be Thomas Steiner Matt Round Jono Alderson Martin Schierle Hajime Sano Lars Knudsen in 🇩🇰 Shunya Shishido KΞNNΞTH C.⚡ Dominic Cooney Ben for Real Johan Westling 🇦🇽 Luis Montes⚡🚲

Comments and Replies

Rijubrata BhaumikRijubrata Bhaumik
Thanks to Francois Beaufort's CL (chromium-review.googlesource.com/c/chromium/src…) soon device name will show "infrared" to differentiate other front facing cameras.
Rijubrata BhaumikRijubrata Bhaumik
Cool ! Can't wait to check on Pixel 4 how our demos might work (riju.github.io/depth-camera-w…). @Paul_Kinlan: as you know we enabled depth stream on Chrome (for RealSense /depth cameras).. some pics with IR (colorised to show dots from IR beam) and depth info
Kyle EhrlichKyle Ehrlich
The surface book 2 (and I'm sure other windows hello enabled laptops) also let you access the IR camera (at least in chrome)
Paul KinlanPaul Kinlan
I don't know. I'll dig around .
Paul KinlanPaul Kinlan
It's the one time I think I look better than you :)
AwaisAwais
😂
Tony-STony-S
You know what's weird? Using a Pixel 3 this gets you 3 front facing cameras and physically it has only 2. And the image doesn't change between the last two, so I wondered what the third one is suppose to be.
Paul KinlanPaul Kinlan
Ah pooh. Sorry.
Dan JenkinsDan Jenkins
My Tesla lists 8 cameras in enumerateDevices 😂 - but no gum for allowing access so no names available ! (And also no camera access due to no gum)
Dan JenkinsDan Jenkins
And yet we can't output audio to the earphone speaker (bug opened recently) 😂
Paul KinlanPaul Kinlan
I actually think this is a by-product of it just being a camera.
Anthony MakiAnthony Maki
webrtc.github.io/samples/src/co… 🙃
Martin SchierleMartin Schierle
This might also enable some very cool possibilities for environment protection use cases (e.g. plant growth analysis via infagram): infragram.org
Martin SchierleMartin Schierle
Finally I can go ghost-hunting on the web, app-less :-)
Mr.doobMr.doob
Reminds me to Rubber Johnny 😁
Jake ArchibaldJake Archibald
nah he means the same thing
Jake ArchibaldJake Archibald
Link to the demo!!
Paul KinlanPaul Kinlan
Rubber Johnny has a totally different meaning where I'm from
KΞNNΞTH C.⚡KΞNNΞTH C.⚡
@rijubrata FYI
Eric Lawrence 🎻Eric Lawrence 🎻
Ideas for what to use it for-- hidden surveillance camera detection.
Luis Montes⚡🚲Luis Montes⚡🚲
Paul, what have you unleashed... I'm 80s era Bruce Banner getting beat up by a group of street toughs.
rektide de la fayrektide de la fay
It can access what, three different cameras? a "front"/back/ir? Not bad!