Loading
0 Follower
0 Following
edhayes1
Edward Hayes

Location

GB

Badges

2
0
0

Activity

Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Behavioral Representation Learning from Animal Poses.

Latest submissions

See All
graded 205508
graded 205505
graded 205474

Round 1 - Completed

Latest submissions

See All
graded 185053
graded 184985
graded 184944
Participant Rating
Participant Rating

Multi Agent Behavior Challenge 2022

Share your solutions!

About 1 year ago

My solution is posted here: 2nd Place Solution
Thanks

External Data

Over 1 year ago

What are the rules regarding the use of external data (MARS, Mouse100, CRIM13) etc?
Are we free to use these?

Thanks

MABe 2022: Mouse Triplets

2nd Place Solution

Over 1 year ago

Hi All,

Thought I might share my solution for the Mouse Triplets task, in case someone finds it interesting.

In brief:
Bert style encoder, masked span modelling similar to SpanBERT. I preferred masked modelling because autoregressive/seq2seq wouldn’t have both past and future context. After some experimentation I chose a window size of 80 frames.

Separate input sequences for each mouse, separated by a SEP token, so that the model is able to attend over actions of other mice in order to solve masked modelling.

Having separate sequences gives us an embedding for each mouse, we can use these to predict features for them (speed, body length etc).

We then can create representations between mice by taking the embedding for one and taking it away from another. From this embedding we can predict features (distance between the mice, angle from one to another etc).

We pool all the outputs using attention, and apply a contrastive objective, where positive pairs are two sub-sequences randomly sampled from the same sequence, negative pairs are other members of the batch. We can also predict “global” features using this representation (area of triangle formed by the mice).

To create the final embeddings we create overlapping windows, so that all of the embeddings have additional context, we then concatenate the embeddings for each mouse.

Congratulations to all the winners and participants, and thank you to the organisers for an interesting problem!

Please note: The code could do with some cleaning up which I haven’t got round to yet.

edhayes1 has not provided any information yet.