Latest Sketches:

WebGL Based

2D Vector Based

Goal: Construct a 2D square that distorts based on viewing angle, so that it appears like a square no matter what angle it is viewed from. The heart of the matter is to explore how personalized reality is also distorted reality.

Inspiration:

1. Sidewalk Chalk Art

1. Johnny Chung Perspective Experiment

   Screen Recording 2024-05-02 at 9.32.59 AM.mov

2. Ryan Carl - Perspective

Screen Recording 2024-05-07 at 9.53.25 AM.mov

Elements:

1. Calculate viewing angle with ml5 eye tracking
2. Distort square based on angle

Viewing Angle Tracking

How I did it:

We know the webcam horizontal field of view is 122 degrees, and the aspect ratio of the frame is 16:9. From there we calculate a vertical field of view of 100 degrees using this formula.

With horizontal and vertical FOV as well as canvas dimensions, we can then convert the x,y, position of the sightline, using eye key point tracking, into viewing angle:

Screen Recording 2024-05-02 at 9.42.39 AM.mov