360º Face recognition and Gaze Analysis

I need ”face recognition and gaze analysis” of 5 members of a 15 minutes meeting, from a 360º camera.

In particular, analysis of videos obtained with the 360º camera "Ricoh Theta V”.

Skills: Face Recognition, Video Processing, 360º analysis, Image Analysis, real time analysis, gaze analysis, Python, English

[Longer Description]

The first challenge of this project is face recognition on a video of a 360º, because normally face recognition are created to plain faces, not curved faces of 360.

Second Challenge y to analyze the gaze of each person, obtained, who looks who, during the meeting, with a frequency of 1 seconds. That is my final data that I want.

I need the analysis of this data during less time posible, with a maximum limit of 60 minute after the end of meeting.


Third Challenge, you need to do this with video of 15 minutes that the "Ricoh Theta V" camera provides.I will not have this camera in short time, because the pandemia. Then you need to find this video on the web, or simulate the data.

This is the format that I need and the data output:

I need that you develop in Python language. And the output of information will be, second by second in this format:

[login to view URL],2,1,1,1,1

[login to view URL],3,1,5,5,1

[login to view URL],5,3,2,3,4

[login to view URL],3,4,4,3,1

[login to view URL],4,5,5,3,3

The first 14 numbers are the date, hour, minutes and seconds of the 15 minutes meeting, the last five numbers are the information about who looks who. For example, the last five numbers in the first row are: "[login to view URL],2,1,1,1,1". Then the gaze analysis for the second number 35 are:

-person number 1 is looking to person number 2,

-Person number 2 is looking person number 1,

-person number 3, is looking person number 1

-person number 4, is looking person number 1.


-person number 5, is looking person number 1.

I need this data for the 15 minutes of the meting, in CVS file. Then I will use that data for my own analysis.

Also, I don't know how to run a Python terminal, then if you can give me a very basic interface where I can import the video, put the date, number of participant (minimum and maximum), Name of Participant associated with (person 1, person 2, person 3, etc), and other information that you think is relevant for this analysis. And then I could export the result of this analysis in the .CVS archive.

I need this data for the 15 minutes of the meting, in CVS file. Then I will use that data for my own analysis.

Also, I need that the you coding in English, with also comments in english, then a developer in Chile could confirm that is easy to understand, run and changed, if is necessary.

For first test, I have a 10 second example of a "360º Ricoh Theta V" camera video.

[login to view URL]

Arcfelismerés Video Processing 360 fokos videó Image Processing Python

Projektazonosító: #25111474

A projektről