Our latest hand-tracked mixed-reality experiment, with half-size Rainbow and larger, longer-fingered gloves a deliberate treat tin, and a more realistic pickup-and-chewing sequence. Place Rainbow wherever you want first; she then notices an offered hand and leans forward to give it her signature face bump. The 3D cat is an early sculptural prototype; her real-life markings guide the design.
Say hello in passthrough
On your Quest 3, open this page in Quest Browser, put down the controllers, and press the button below.
First place Rainbow by looking toward the spot you want. Pinch your right hand to set her down. Pinch your left hand to cycle through distances, or choose a starting distance and height below. Once placed, her position is locked until webpage reload. For a face bump, offer an OPEN hand. For a treat, reach toward the small floating tin at your right after placing Rainbow. Open your hand, then pinch thumb and index finger TOGETHER AT THE TIN to take exactly one biscuit. Carry it near Rainbow, then open those fingers to drop it. Pinches elsewhere do not create treats.
The optional virtual gloves have covered palms, a wrist cuff and smoothly bending, fully covered fingers — not joint dots. The camera image of your real hands may still show around their edges. Rainbow is now half her previous size. After placement, hand gestures cannot reposition her. The treat can only be taken from the small floating tin near your right hand. No OK sign creates it out of thin air. The treat uses an estimated horizontal floor plane, not detected room geometry; place her on the rug/floor and drop treats near her front paws. To restart placement, reload the webpage. Stay aware of real furniture; the virtual cushion does not detect actual surfaces.
Checking headset support…
Quest 3 test — version 003.5
- Confirm color passthrough shows your real room.
- Confirm you can see Rainbow in both eyes and see solid gloves covering your palms and all five fingers (not fingertip dots or joint markers).
- Move her preview by looking around, then place her.
- Right pinch to place her, then offer an open hand near her nose: she leans toward you.
- Gently move closer: does the half-size Rainbow bump and purr?
- Try petting her back and the base of her tail. Her whole body should remain anchored.
- After placement, locate the floating treat tin on your right. Open your hand and pinch directly at the tin to pick up one biscuit. Pinches anywhere else, including Meta menu gestures, must NOT create treats. Open your fingers near Rainbow to drop it. Her head should cover the treat, lift with it visibly in her mouth, then chew and swallow.
- Tell us what feels right or wrong: cat size, height, orientation, and reach distance.
Gloves are 3D overlays, not a way to turn off the Quest passthrough camera image. This prototype uses an estimated floor rather than room surface detection, and does not yet have belly-rub behavior. We are testing fundamental contact and response first.
The real Rainbow
Our model is based on Rainbow's dark tortoiseshell coat, green eyes and striking asymmetrical mouth markings. A responsive, lifelike version will take several experiments.
This is a separate project from Dinoscores and the Hand Tracking Lab. No player progress is changed.