Designer Cyril Diagne (AI/UX “artist” in residence at Google) has built a beta AR app that takes IRL objects and adds them to your photoshop work. It’s real world copy paste.
“Here’s how it works: you point your phone at a book sitting on your desk, the software produces an image of just the book on your phone screen, you point the phone at your computer, and the book image gets pasted into the Photoshop document. It looks like straight-up magic (or at least like a scene from Minority Report or something):”
Check out Cyrils thread about how the sausage gets made:
And again, the OpenCV SIFT trick to find where the phone is pointing at the screen.
I also packaged it as a small python library: https://t.co/en0EyGSklp
Send a camera image + a screenshot and you get accurate x, y screen coordinates! pic.twitter.com/OOCFrrZseZ
— Cyril Diagne (@cyrildiagne) May 3, 2020
Why it’s hot? Why it’s hot you ask?!
Well. The computers are taking our jobs. Just kidding. Their making our jobs easier. This is the kind of seamless transition that we wish our phones and work computers could have with each other. Our new digital first age (put on overdrive due to the coronavirus) is taking us to places we’ve only dreamed of — now we get to see our dreams as reality!