Loading
3 Follower
1 Following
jack_vandyke

Organization

IGS Energy

Location

US

Badges

1
1
0

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Challenge Categories

Loading...

Challenges Entered

Detecting Energy Flexibility in Buildings

Latest submissions

See All
graded 300513
graded 300504
graded 300497
Participant Rating
yusuf_dogu 0
ryan_sharp 0
ibrahim_yucel 0
Participant Rating
ryan_sharp 0

Flextrack Challenge 2025

๐Ÿ† Final Results & Next Steps

About 1 month ago

It appears that the final rankings have undergone several revisions. In light of this, I would like to raise one final question for the competition organizers: why were classification metrics not included in the final ranking criteria?

The competitionโ€™s stated objectives are to:

  • Identify when demand response events were activated and for how long
  • Quantify how much energy consumption increased or decreased during these events compared to normal conditions.

The first objective is inherently a classification problem, while the second is a regression problem. Given this dual focus, it seems logical that both types of metrics should contribute to the final evaluation.

In particular, while the F1 score is generally more informative than the Geometric Mean for assessing classification performance, a balanced combination of both could provide a more comprehensive and fair assessment. I suggest this blended approach be considered for both the competition phase and the final round.

Final Round Test Set Released ๐Ÿงจ๐Ÿš€

About 1 month ago

Iโ€™m hoping soon! My F5 key needs a break and Iโ€™ve been a bit distracted at work waiting for these results.

Edit: itโ€™s been over 24 hours nowโ€ฆ May we please get confirmed final results? Or are these the final results?

Important Update

About 2 months ago

How will participants be able to perform feature engineering in phase 2? It sounds like the structure of the data will be pretty different from phase 1 which may cause problems.

Can we use future data?

2 months ago

๐Ÿ“น Townhall Recording & Q&A with Challenge Organisers | How to use digital twin data to predict demand response capacity

2 months ago

The competition overview clearly addresses the t+1 problem!

โ€œThis challenge focuses on identifying and estimating demand response activity. Participants are to develop a machine learning model that back-cast (from historic time-series data from buildings) to:

  • determine when demand response events were activated and for how long,
  • determine how much energy was increased or decreased (over the event duration), compared with normal consumption, as a result of activating demand response mode.

Participants will use ground truth time-series data with known observed demand response events (identified in the form of demand response flags) to learn site consumption behaviour both (i) when demand response mode is not active and (ii) when demand response mode is activated.โ€

Backcasting in machine learning is the process of generating or predicting unknown historical data using present information. How exactly are we supposed to interpret the quoted text???

๐Ÿ“น Townhall Recording & Q&A with Challenge Organisers | How to use digital twin data to predict demand response capacity

2 months ago

It mentions backcasting which we know means using t+1,2,3, etc. if necessary

Clarification on Future Data and Back Cast

2 months ago

If thatโ€™s the case, you need to wipe the current leaderboard and fix the competition description. Whyโ€™d the description say weโ€™re to build models that back-cast if weโ€™re now being told thatโ€™s against the rules? What a complete waste of time for many teams. Very frustrating.

Please explain what was meant by the following:

โ€œThis challenge focuses on identifying and estimating demand response activity. Participants are to develop a machine learning model that back-cast (from historic time-series data from buildings) to:

  • determine when demand response events were activated and for how long,
  • determine how much energy was increased or decreased (over the event duration), compared with normal consumption, as a result of activating demand response mode.

Participants will use ground truth time-series data with known observed demand response events (identified in the form of demand response flags) to learn site consumption behaviour both (i) when demand response mode is not active and (ii) when demand response mode is activated.โ€

๐Ÿ“น Townhall Recording & Q&A with Challenge Organisers | How to use digital twin data to predict demand response capacity

2 months ago

Hello. In the competition description, you state: โ€œParticipants are to develop a machine learning model that back-cast (from historic time-series data from buildings) to:โ€ฆโ€

A back-cast is using present/future data to predict past values. You state around the 40-minute mark that this actually isnโ€™t allowed.

Your competition description explicitly says back-cast but your Q&A states the opposite. Could we please get clarification?

๐Ÿ’ฌ Feedback & Suggestions

3 months ago

Awesome, thanks. Looking forward to a fun competition!

๐Ÿ’ฌ Feedback & Suggestions

3 months ago

Well, Iโ€™ve figured out how to find my submission, but itโ€™s been 19 hours with no update. Just submitted with the message, โ€œSuccessfully enqueued 1 Job.โ€

Is this wait time expected? Iโ€™m coming from Kaggle, so my expectations might be misaligned with how competitions like this usually work.

๐Ÿ’ฌ Feedback & Suggestions

4 months ago

Hello! Is there a way to track progress on submissions? I made a submission a couple of hours ago and have no clue if it was successful and is just taking time to be scored or if it failed. The only indication that I even made a submission is my 10 daily submissions going to 9.

jack_vandyke has not provided any information yet.